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The Social Psychology of Gullibility 


Gullibility, whether we like it or not, is a fundamental characteristic of 
human beings. In The Social Psychology of Gullibility, Forgas and Baumeister 
explore what we know about the causes, functions, and consequences of 
gullibility, and the social psychological processes that promote or inhibit it. 

With contributions from leading international researchers, the book 
reveals what social and cognitive psychology contribute to our understand¬ 
ing of how human judgments and decisions can be distorted and under¬ 
mined. The chapters discuss the nature and functions of gullibility, the role 
of cognitive processes in gullibility, the influence of emotion and motiva¬ 
tion on gullibility, and social and cultural aspects of gullibility. Underpinned 
by a wealth of empirical research, contributors explore captivating issues 
such as the psychology of conspiracy theories, the role of political gullibility, 
gullibility in science, the role of the Internet in fostering gullibility, and the 
failures of reasoning that contribute to human credulity. 

Gullibility has become a dominant topic of interest in public discourse. 
The Social Psychology of Gullibility is essential reading for researchers, social 
science students, professionals, and practitioners and all those interested in 
understanding human credulity and the role of gullibility in contemporary 
public affairs. 

Joseph P. Forgas is Scientia Professor at the University of New South 
Wales. His research focuses on cognitive and affective processes in inter¬ 
personal behavior. For his work he received the Order of Australia, and 
the Distinguished Scientific Contribution Award from the Australian 
Psychological Society. 

Roy F. Baumeister is Professor of Psychology at the University of 
Queensland. His research deals with self and identity, self-control and self¬ 
esteem, finding meaning in life, sexuality, gender, aggression, and emo¬ 
tion. He received the William James Award from the Association for 
Psychological Science for his lifetime achievements. 



The Sydney Symposium of Social Psychology series 


This book is Volume 20 in the Sydney Symposium of Social Psychology series. 
The aim of the Sydney Symposia of Social Psychology is to provide new, 
integrative insights into key areas of contemporary research. Held every year 
at the University of New South Wales, Sydney, each symposium deals with an 
important integrative theme in social psychology, and the invited participants 
are leading researchers in the field from around the world. Each contribution 
is extensively discussed during the symposium and is subsequently thoroughly 
revised into book chapters that are published in the volumes in this series. For 
further details see the website at www.sydneysymposium.unsw.edu.au 
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Introduction 

Gullibility as a scientific concept does not currently feature prominently 
in social psychology research, and one would search in vain the subject 
indexes of many social psychology textbooks for entries under “gullibil¬ 
ity.” So why devote an entire book to this topic, and why do it now? The 
answer is twofold. First, in the past few years, and especially since Brexit, 
the election of Trump, and the emergence of crypto-fascist dictators in a 
number of countries including some inside the European Union such as 
Hungary (Albright, 2018), the question of human gullibility has become 
one of the dominant topics of interest in public discourse (see also Cooper 
& Avery, Chapter 16 this volume; Myers, Chapter 5 this volume). People 
opposed to these developments often suspect that those who voted for 
them must be gullible. 

Second, even though gullibility is rarely studied directly in social and 
cognitive psychology, these disciplines do have a great deal to contribute to 
our understanding of how human judgments and decisions can be distorted 
and undermined. In consequence, a book dealing with the social psychol¬ 
ogy of gullibility is highly topical, and as this volume demonstrates, there 
is a wealth of directly relevant empirical research we can draw upon to 
understand this phenomenon (Gilbert, 1991; Gilovich, 1991). The objec¬ 
tive of this volume is thus to provide an integrative survey of the current 
state of social psychological research on human gullibility, and so offer an 
informative contribution towards understanding the role of gullibility in 
contemporary public affairs. 


What Is Gullibility? 

Gullible as a term was first recorded in 1793, derived from the earlier word 
“cullibility” (1728), and possibly connected to “gull,” a cant term for “dupe, 
sucker,” which in turn is of uncertain origin. Its etymological roots can be 
traced perhaps from the bird (sea gull), or to the verb “gull” (to swallow). 
Some of the synonyms of gullibility, such as credulity, ardessness, ignorance, 
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inexperience, simplicity, also confirm the pejorative character of gullibility. 
So consensually negative social evaluation, as we shall see later, is an essen¬ 
tial component of gullibility. 

The standard definition of gullibility, as a failure of social intelligence in 
which a person is easily tricked or manipulated into an ill-advised course of 
action, confirms this view. Gullibility is closely related to credulity, which is 
the “tendency to believe unlikely propositions that are unsupported by evi¬ 
dence” (Wikipedia). Gullibility is thus a factor in social influence processes, 
as a person’s willingness to believe false or misleading information facilitates 
the influence. 


The Criteria for Gullibility 

Is there some accepted standard of truth or reality relative to which a person 
can be judged as gullible? Conceptually, gullibility can be inferred in one of 
two situations. Either an individual’s beliefs are manifestly inconsistent with 
facts and reality, or an individual’s beliefs are at variance with consensual 
social norms about reality. A believer in a flat earth can now be labeled as 
gullible, since there is ample empirical evidence confirming the true state of 
affairs. However, the question of criteria for gullibility is far more complex. 
We often use the term gullible to describe persons whose beliefs violate some 
consensual rather than scientific standard of how reality should be viewed. 
Serious and largely unresolved philosophical issues about the nature of 
knowledge within the domains of ontology (the philosophical study of what 
is, the nature of reality), and epistemology (the philosophical study of how 
do we know) also make the unambiguous definition of knowledge, and by 
implication, gullibility, problematic (see Krueger, Vogrincic-Haselbacher, 
& Evans, Chapter 6 this volume). 

Adopting a Popperian epistemological view, and accepting that all 
knowledge is imperfect and temporary, offers little help towards defining 
gullibility. Even on matters amenable to scientific research and potential 
falsification, such as the iatrogenic climate change theory, there remains 
ample scope for agnosticism and disagreement (Lewandowsky, Oreskes, 
Risbey, Newell, & Smithson, 2015). Our knowledge about the world is 
imperfect, and the more complex the question we address, the more likely 
that unequivocal answers are difficult to find. We can label those who 
question the truth of the climate change hypothesis as “gullible,” or with 
a rhetorical flourish, as “deniers,” as if there was an absolute and incon¬ 
trovertible truth here to be denied (see also Jussim, Stevens, Honeycutt, 
Anglin, & Fox, Chapter 15 this volume). Yet those who remain skeptical 
or agnostic on this issue can reciprocally label absolute believers in the 
climate change hypothesis as gullible. Believers in conspiracy theories also 
often see themselves as careful, motivated skeptics who are motivated by 
a quest to avoid gullibility, while those who doubt their beliefs are the 
gullible ones (see Douglas, Sutton, & Cichocka, Chapter 4 this volume; 
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Unkelbach & Koch, Chapter 3 this volume; van Prooijen, Chapter 17 this 
volume). As long as knowledge is incomplete and subject to future falsifica¬ 
tion, identifying gullibility is more a matter of consensual value judgment 
rather than a statement of incontrovertible fact. Gullibility may thus often 
be a matter of perspective, residing in the eye of the beholder. It is no 
wonder, then, that gullibility has been historically an endemic feature of all 
human societies, as the next section will suggest. 


The Social History of Gullibility 

Human cultural history is replete with striking examples of human gullibil¬ 
ity (Greenspan, 2009; Koestler, 1967; Rath-Vegh, 1963). In an attempt to 
understand, predict and control the social and physical world, humans have 
created an amazing range of absurd and often vicious and violent gullible 
beliefs (Koestler, 1967). Ancient meso-American cultures believed that cut¬ 
ting out the beating hearts of thousands of their captives was essential to 
preserve the goodwill of their gods and to ensure a good harvest (Koestler, 
1967, 1978). Throughout the Middle Ages, witches were tortured and 
burned to death for allegedly harming others (Pinker, 2012). As recendy 
as at the beginning of the eighteenth century, even a well-educated person 
might still firmly believe in witches, werewolves, magic cures and magic 
potions, alchemy, and of course, a flat earth (Wooton, in Pinker, 2018). 

Contemporary religious beliefs about virgin birth, walking on water, 
resurrection, or transubstantiation continue to persist yet they contradict 
everything we know about the world. Folk tales and literature abound with 
demonstrations of the pitfalls of gullibility. In the Bible, the serpent’s decep¬ 
tion, and Adam and Eve’s gullibility are the primal source of humanity’s 
eternal fall from grace. Homer’s Trojan Horse is a classic tale of decep¬ 
tion and gullibility, and Shakespeare’s Othello is a tragedy brought about by 
credulity. In tales such as the “Emperor’s New Clothes” we leam that the 
veil of consensual gullibility can sometimes be tom apart by a single voice 
that reveals the truth. In “Little Red Riding Hood,” the heroine is first 
deceived, but then she leams the art of deception herself to deceive a second 
wolf. Even more instructive is the character of Pinocchio who had to learn 
to avoid being duped by others in order to become a full human being (!). 

Examples of striking gullibility, self-deception, hubris, and wishful thinking 
continue to characterize human affairs to this day (Greenspan, 2009), includ¬ 
ing where one would least expect it, in the halls of academia (Jussim et al., 
Chapter 15 this volume). Sokal’s famous hoax in submitting a text intention¬ 
ally full of nonsense to a “reputable” post-modernist journal where it was duly 
accepted is a well-documented recent example of academic gullibility in the 
humanities. More recendy, Pluckrose, Lindsay and Boghossian (2018) perpet¬ 
uated an even more impressive hoax, successfully publishing seven (!) explic¬ 
itly nonsensical “academic” papers, including one using text from Hider’ 
Mein Kampf in highly reputable feminist and “grievance studies” journals. 
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In the economic sphere, irrational gullibility produces recurring investment 
“bubbles” at least since the famous “tulip bulb” craze in the eighteenth cen¬ 
tury. Our social rituals associated with April Fool’s Day gain their popular¬ 
ity by allowing us to mislead others without adverse consequences, and so 
practice our skills of deception (Forgas, 2017). These examples, and countless 
others, suggest that far from being an aberration, gullibility seems a pervasive 
feature of the human condition. This pattern continues today, with some¬ 
times alarming consequences, an issue we will turn to next. 


Truth and Gullibility in Contemporary Public Life 

Concern with gullibility in public life has become highly topical in recent 
years. Gullibility may have played some role in the election of leaders like 
Trump. His detractors regard his supporters as gullible for supporting a 
novice politician who claims to be a world expert on almost everything 
and has a narcissistic view of his own abilities (see also Myers, Chapter 
5 this volume). Meanwhile, his supporters view his detractors as gulli¬ 
ble for embracing the “politically correct” views and practices and relish 
Trump’s overt, mocking rejection of what they regard as elite hypocrisy. 
Another recent surprise election outcome was Great Britain’s vote to leave 
the European Union, marked by excesses of credulity on both sides. Voters 
willingly believed contradictory forecasts of either a smooth exit or impend¬ 
ing economic catastrophe. Elsewhere, voters seem blithely willing to elect 
and re-elect quasi-fascist nationalist leaders who are destroying their hard- 
won democratic systems (Hungary, Poland, Turkey, Russia, Phillipines, 
Venezuela), or succumb to misleading messages laced by archaic national¬ 
ism and populism (Catalonia, Scotland, etc.). 

Gullibility is found across the political spectrum. Fascist leasers from 
Mussolini and Hitler to Erdogan, Putin, and Orban have exploited voters’ 
gullibility with disastrous consequences. Arguably, the fascism of Mussolini 
and Hider was closely linked to the political left. The Nazi party was the 
“National Socialist German Workers’ Party” that admired and copied 
America’s New Deal, while Mussolini was lionized in US progressive circles 
(Goldberg, 2008). It is especially puzzling how a closed and quasi-religious 
system of thought such as Marxism could remain the dominant philosophi¬ 
cal perspective of many left-leaning Western intellectuals for over a hundred 
years. This occurred, despite the fact that Marxism’s economic predictions 
have been consistently wrong, its view of history as class struggle has been 
misconceived, and the social systems it produced turned out to be perhaps 
the most horrific and genocidal in human history. Part of the answer is that 
as Karl Popper (1947) showed, totalitarian systems of thought like Marxism 
are constructed to be unfalsifiable, and so their lack of predictive power can 
always be explained away by “true believers” (Koestler, 1967). Most reli¬ 
gions have the very same immunity to disproof. 

Over the past few decades, Marxism and Marxist intellectuals have 
promoted a range of social theories and movements to gullible followers 
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ostensibly to increase socialjustice and equality, but in reality, relying on the 
collectivist rhetoric of group rights, identity politics, and collective social 
class struggle as the sole method of social progress. These quasi-Marxist col¬ 
lectivist movements, like radical feminism and multi-culturalism, are fun¬ 
damentally incompatible with the Enlightenment emphasis on the rights of 
the individual (Pinker, 2018). Arguably, some versions of radical feminism 
even display elements of classical conspiracy theories, suggesting the exist¬ 
ence of an entirely fictitious gender-based conspiracy against women. True 
believers in such ideologies are no less gullible than earlier believers in simi¬ 
larly closed systems of thought. 

One important recent influence promoting gullibility is the advent of 
Internet-based communication. Until recently, it was the privileged class of 
experts, truth-seekers, and truth-tellers who following the Enlightenment 
were institutionally established in our social systems and whose job it was 
to discover and communicate truth. They have now lost their privileged 
position and information monopoly, and it seems truth in public life is 
now also at risk. It would indeed be an ironic and paradoxical effect if 
the immense success of our “scientic age” would be undermined by the 
very scientific progress and information technology it helped to create. 
Given the damage that populism, demagoguery, “fake news,” and the ris¬ 
ing tide of identity politics and nationalism have produced in our public 
life, a better understanding of the social psychology of gullibility is now 
recognized as of considerable importance (Albright, 2018; Pinker, 2018; 
see also Cooper & Avery, Chapter 16 this volume; Myers, Chapter 5 this 
volume). This is one of the main objectives of this book. First, however, 
we need to consider why gullibility seems to be so prevalent across the 
ages, the task of the next section. 

The Functions of Gullibility 

Why is gullibility such a fundamental and universal characteristic of Homo 
sapiens ? One of the psychological foundations of gullibility, paradoxically, 
appears to be the universal human capacity for trust - to accept second¬ 
hand information we receive from others as a proxy for reality (Deutsch 
& Gerard, 1955). Indeed, our evolutionary history (Harari, 2014; Pinker, 
2018; von Hippel, 2018) suggests that perhaps the most revolutionary cog¬ 
nitive development of our species occurred when we made the dramatic 
leap from being creatures who are bound by immediate reality to becoming 
creatures who can accept and act on consensual symbolic information or 
“memes” as if it was reality (Dawkins, 1976; Dennett, 2017). This ability to 
accept symbolic information from others and treat it as real is also one major 
foundation of all human cultural evolution (Harari, 2014). Unlike face-to- 
face primate groups that can only achieve cohesion and coordination as a 
result of their daily integrative interactions, large-scale social coordination 
in complex and impersonal human societies is only possible if individuals 
consensually accept various shared fictional notions as reality. 
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In these terms, most of human cultural history is essentially the history 
of changing fictional beliefs in various symbolic systems of thought (Harari, 
2014). For thousands of years, social organization was predicated on shared 
religious beliefs, legitimizing the divine powers of priests and rulers. In 
Japan, this fiction was still firmly believed by the majority of the popula¬ 
tion in the middle of the twentieth century. Similarly, it was consensually 
believed for most of human history that enslaving others is natural and 
slavery continued to be a dominant form of economic organization until 
the recent past. From the current perspective these beliefs could be seen as 
examples of collective gullibility. Yet modern attitudes toward slavery also 
indicate gullibility, assuming that it was always morally offensive, when 
in fact slavery originated as a form of moral progress. It was originally a 
substitute for being killed in battle, and surrendering soldiers no doubt 
accepted slavery as an improvement over being tortured to death, which 
was often the fate of captives in primitive and hunter-gatherer societies. 
Even today, beliefs in dubious phenomena such as homeopathy, crystals, 
alternative therapies, anti-vaccination, supernatural interventions in daily 
life, and even alien abductions, not to mention conspiracies of all kinds, 
still abound (see also Douglas et al., Chapter 4 this volume; van Prooijen, 
Chapter 17 this volume). 

Gullibility, in the non-pejorative sense of accepting, sharing, and consid¬ 
ering as real unconfirmed and fictional social information from others can be 
highly functional and the cognitive foundation of large-scale human social 
organizations. Our current culture relies no less heavily on shared fictional 
beliefs than was the case in previous epochs. The idea of the nation state 
as a fictional symbolic entity is still the basis of much political organiza¬ 
tion today, yet it was only invented relatively recently (Harari, 2014). Or 
take the example of paper money: its usefulness is utterly dependent on the 
shared fictional belief that it has real value. The moment this shared fiction 
breaks down - in times of war, financial crisis, hyperinflation, etc. - the 
once valuable banknotes become useless bits of paper. 

Our own epoch is based on the dominant cultural and moral values of 
the Enlightenment: the shared belief that humanism, individual liberty, and 
equality are universal, desirable, and natural values. Is this not also a fiction? 
Clearly liberty is neither a natural, nor a universal state for human beings in 
the real world. Equality is even more nebulous: as long as people are born 
with hugely different biological, intellectual, and physical characteristics, 
in what sense can one talk about, or even define equality as a meaningful 
universal value? As Dahrendorff (1975) showed, the two core values of the 
Enlightenment, liberty and equality, also happen to be mutually incompat¬ 
ible: any increase in equality reduces liberty, and vice versa. These core 
beliefs turn out to be just as fictional as the notion of divine royalty. Yet 
modern “gullibility” in believing these fictions has been extremely useful 
and allowed modern citizens to design and maintain perhaps the most suc¬ 
cessful civilization in human history (Pinker, 2018). 
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We could easily imagine some future utopia (or more likely, dystopia) in 
which our currently shared fictional beliefs about liberty and equality will 
be considered extremely silly and gullible. Yet this gullibility can be a very 
useful and adaptive cognitive mechanism that allows large and complex 
social organizations to function on the basis of such shared fictional beliefs. 
So today’s accepted truth can easily become tomorrow’s gullibility as our 
consensual beliefs change. If gullibility is indeed a universal, and often useful 
human characteristic, what are the psychological mechanisms that promote 
it? We shall turn to examining that question next. 

Psychological Mechanisms of Gullibility 

We have seen that there is good historical and evolutionary evidence indi¬ 
cating that a disposition towards gullibility - seeing the world not as it is, 
but as it appears and as others explain it - is a deeply ingrained human 
tendency. In a way, human evolution has left humankind with cogni¬ 
tive predispositions that promoted individual survival in traditional archaic 
societies, but that are perhaps less well adapted to thriving in a modern one 
(Pinker, 2018). 

Within psychology, human judgments and decisions were traditionally 
studied using the model of the rational information processor (Piaget, 1950) 
or “naive scientist” (Heider, 1958; Kelley, 1967) as the preferred model. 
However, growing evidence for irrationality or “bounded rationality” has 
now forced a fundamental re-think (Jones & Harris, 1967; Kahneman & 
Tversky, 2000), as massive violations of principles of rational thinking were 
demonstrated both in the laboratory, and in real life. Many of the failures in 
human reasoning also turn out to be highly resistant to monitoring and con¬ 
trol (see also Fiedler, Chapter 7 this volume). Rather than simply demon¬ 
strating irrationality, such apparent cognitive failures can be better explained 
as having some adaptive functions (Gigerenzer, 2000; Simon, 1990). 

In this section we shall briefly review some of the major cognitive 
mechanisms — many of which could also be conceived as evolutionary “mind 
modules” — that promote gullibility. These information processing mecha¬ 
nisms can be understood as representing either “cold” cognitive processes 
(such as limited processing capacity, reliance on heuristics or shortcuts, etc.), 
or by “hot” motivational tendencies where certain (often gullible) outcomes 
are preferred to others (see also Baumeister, Maxwell, Thomas, & Vohs, 
Chapter 2 this volume; Macrae, Olivier, Falben, & Golubickis, Chapter 11 this 
volume; Dunning, Chapter 12 this volume; Mayo, Chapter 8 this volume). 


The Search for Patterns and Meaning 

The search for patterns, associations, and meaning is one of the most fun¬ 
damental characteristics of the mental life of human beings, one that played 
a significant role in human adaptation and survival (von Hippel, 2018). 
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While sense-making is mostly adaptive and functional, the bias toward seek¬ 
ing and finding patterns and causation where there are none can also be a 
major source of gullibility. The bias toward meaning is particularly notice¬ 
able when people perceive order in objectively random (and hence, mean¬ 
ingless) events. Human beings tend to under-recognize randomness (see 
also Forgas, Chapter 10 this volume), a tendency often described as apo- 
phenia, a term that was originally used to label early stages of schizophrenia 
(e.g., Brugger, 2001). 

A good example is the clustering illusion, a cognitive bias where people 
see patterns in randomly generated data (Chapman, 1967; Gilovich, 1991). 
Another well-known example is pareidolia, where people perceive patterns 
or familiar shapes and images in vague or otherwise random stimuli, such 
as the shapes of clouds, or, in shapeless inkblots as in the now discredited 
Rohrschach test. Meaningless, randomly generated word sequences when 
described as “psychology jargon,” or as New Age wisdom can also be per¬ 
ceived as meaningful, a phenomenon Pennycook, Cheyne, Barr, Koehler, 
and Fugelsang (2015) labeled “bullshit receptivity” (see also Forgas, Chapter 
10 this volume). 

Over-perceiving patterns can be adaptive, as the cost of not perceiv¬ 
ing a pattern where there is one is often higher than perceiving a pat¬ 
tern where there isn’t one. Evolutionary psychologists suggest that pattern 
over-perception occurs because of the greater costs associated with Type II 
than Type I errors. Failing to make the connection between, for instance, 
a noise and the presence of the predator could easily result in death, but 
misperceiving a random noise as a threat has far less serious consequences. 
Adaptive fitness may thus be promoted by deviations from accuracy, 
for example, by over-perceiving the value of potential partners (see also 
Baumeister et al., Chapter 2 this volume), or by over-interpreting the wel¬ 
coming behaviors of potential partners (Haselton & Buss, 2000). 

However, the costs of over-perceiving patterns can also be significant by 
contributing not only to gullibility, but also to obsessive-compulsive disor¬ 
ders, and anxiety (Rachman, 1997). At a societal level, the tendency to infer 
causation in random or unrelated events often produces erroneous beliefs, 
superstition, mistaken inferences, causal mistakes, conspiracy theories, and 
often violence and aggression (Chapman, 1967; Hamilton & Gifford, 1976; 
see also Douglas et al., Chapter 4 this volume; van Prooijen, Chapter 17 this 
volume). Mistaken inferences are easily exploited by misleading political 
propaganda or advertising and play an important role in political judgment 
and decision-making (Myers, Chapter 5 this volume). Throughout history 
much cruelty and violence has been committed in the name of such deeply 
erroneous causal inferences (human sacrifice, witchcraft, etc.; Koestler, 
1967; Pinker, 2012). 

We reiterate, too, that one key innovation in human evolution involved 
deliberately shared information. Is it better to believe what everyone else 
believes, or to be ruthlessly skeptical? Religious skeptics may be superior at 
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truth-seeking, compared to their more gullible fellow group members who 
embrace the religion — but the benefits of skepticism must be compared 
to the costs of being exiled or killed as punishment for deviating from the 
consensus. At the group level, much progress in human history, including 
nation-building, has depended on military success. And military discipline 
often required soldiers to put aside their own skepticism so as to follow 
orders, more or less without question. An army of gullible soldiers blindly 
obeying orders would probably prevail over an equally equipped enemy 
that encouraged each soldier to make up his own mind at each step. 


The Acceptance Bias 

Another potential source of gullibility is the near-universal tendency for 
humans to accept rather than reject incoming information. Following 
Spinoza’s philosophical reasoning, there is now strong evidence to sug¬ 
gest that the human being is bom a natural “believer” (Gilbert, 1991). 
Information received tends to first be coded as “true,” and subsequent 
negation requires further time and effort (see Krueger et al., Chapter 6 
this volume). There are several ways that this overwhelming bias can be 
interpreted. In one sense, this can be due to the adaptive value of trusting 
others in closely integrated ancestral societies. If comprehending a claim and 
believing it initially amount to the same thing, then the human being indeed 
approaches the world with a gullible mindset (see also Mayo, Chapter 8 this 
volume). Research shows that even if a claim is coded as potentially false, 
there are powerful internal motivational mechanisms designed to restore 
coherence not by revising our pre-existing system of mental representation, 
but by actively discrediting the offending claim (see also Cooper & Avery, 
Chapter 16 this volume; Dunning, Chapter 12 this volume), an important 
mechanism of gullibility maintenance. 

The acceptance bias shows how gullibility occurs when people are dis¬ 
tracted by other information, emotion, or time pressure. Disbelief is a sec¬ 
ond step, following the first step in which understanding is simultaneous 
with believing. If people do not get to the second step, they will be more 
likely to believe whatever they were told in the first step. 


The Power of Heuristics 

Human beings are more prone to believe interesting, captivating stories and 
narratives that are salient and easy to imagine (Kahneman & Tversky, 2000). 
When we are exposed to salient, frequent, and thus easily remembered 
information, due to a strange “mental bug” in our information processing 
system, such information will also be seen as more true, reliable, and valid 
(see also Strack, Chapter 9 this volume; Unkelbach & Koch, Chapter 3 this 
volume). These mental shortcuts exacerbate the human inability to see the 
world as it really is. 
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Typically, what is familiar, readily available, salient, focal, representative, 
and colorful captures our imagination and attention, and is given far more 
credence than it deserves. When information is easily accessible and fluid, 
it is more likely to be seen as true (see Oysennan, Chapter 14 this volume; 
Unkelbach & Koch, Chapter 3 this volume). Reliance on heuristics can 
also be promoted by such ephemeral factors as the mood we happen to be 
in (Forgas, 2013). However, as Krueger et al. (Chapter 6 this volume) note, 
the emphasis on heuristics as a source of gullibility only offers, at best, a par¬ 
tial understanding. Heuristics can account for many “false-positive” errors 
(believing something that isn’t true), but tell us little about false negatives - 
not believing something that is true (see also Mayo, Chapter 8 this volume). 


Overbelief in the Self 

Self-serving biases and distortions can be a particularly powerful motiva¬ 
tional source of misjudgments and gullibility (see also Dunning, Chapter 12 
this volume; Macrae et al., Chapter 11 this volume). We are always more 
willing to believe flattering rather than unflattering information about our¬ 
selves, even when the manipulative intent is transparently obvious (Jones, 
1964; Matovic & Forgas, 2018). Overconfidence in the self may have some 
adaptive evolutionary functions (von Hippel, 2018), but the very same ego¬ 
boosting mechanisms could also promote gullibility and produce distorted 
judgments and perceptions. Considerable evidence now shows that people 
often hold their beliefs with far greater certainty than is justified, believe 
that their judgments are more accurate than is the case, and overvalue their 
expertise compared to others (see also Dunning, Chapter 12 this volume; 
Macrae et al., Chapter 11 this volume). It seems that people are not so much 
intuitive scientists as intuitive lawyers and politicians, marshaling evidence 
that confirms their convictions while dismissing evidence that contradicts 
them. They overestimate their own knowledge, understanding, rectitude, 
competence, and luck (Pinker, 2018). 


Social Mechanisms of Gullibility 

Humans are thoroughly social creatures, and our views of the world are fun¬ 
damentally shaped by what others think and do. In a profound sense, all sym¬ 
bolic knowledge is socially constructed and shared. Comparing our views and 
ideas with the views and ideas of others is the way all symbolic reality is con¬ 
structed (Strack, Chapter 9 this volume). Social psychology offers countless 
examples of how such “social epistemology” processes work. In an inherently 
ambiguous and uncertain environment, humans will spontaneously construct 
shared norms and standards that, however arbitrary, will impose a semblance 
of consensual order and predictability on their view of reality (Sherif, 1936). 

Further, such consensual norms, once established, turn out to be very 
resilient and difficult to change — almost as if human minds abhor ambiguity, 
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disorder, and unpredictability (Jacobs & Campbell, 1961). What others think 
and do continues to have a powerful normative influence on human behav¬ 
ior, even if those norms are not internalized, and indeed, disbelieved (Asch, 
1951). It turns out that the very process of openly discussing divergent views 
about reality can be a mechanism that promotes the acceptance of more 
extreme and biased views, as the voluminous research on group polarization 
phenomena shows (e.g., Forgas, 1977; see also Cooper & Avery, Chapter 
16 this volume). It seems that human social evolution shaped human brains 
in such a way that we have become creatures who spontaneously monitor 
each other, and often construct and maintain a consensual rather than “true” 
representation of reality. Indeed, abundant research, dating back to the Asch 
conformity studies in the 1950s, has shown that people often favor get¬ 
ting consensus rather than pursuing the truth (for review, see Baumeister, 
Maranges, & Vohs, 2018). 


Epistemological Failures to Monitor and Correct 

These tendencies are exacerbated by a further epistemological failure as 
human beings fall far short from correctly evaluating incoming informa¬ 
tion in terms of its logical merits (see also Fiedler, Chapter 7 this volume; 
Krueger et al., Chapter 6 this volume). Models of formal reasoning, such 
as the ones proposed by Hume, Bayes, or Pascal, were developed to pro¬ 
vide explicit (although not always mutually consistent) yardsticks by which 
human judgments can be corrected. However, these formal systems of rea¬ 
soning are not a natural part of the way people typically think in everyday 
situations. This raises the question of why human brains evolved to process 
information in such an imperfect fashion. Is detecting the true state of affairs 
not always the most efficient and adaptive way to deal with reality? As we 
have seen, evolutionary psychology suggests that deviations from seeing the 
world as it is can indeed confer significant survival benefits. As Baumeister 
et al. (Chapter 2 this volume) argue, from the perspective of adaptive fit¬ 
ness, falling in love and perceiving our partners as more wonderful than they 
really are may be beneficial for reproduction and hence favored by natural 
selection, as it produces stronger pair bonds and better opportunities for 
raising successful offspring. 

It seems that the human inability to recognize and correct such epistemo¬ 
logical mistakes appears to be a built-in adaptation, a kind of metacognitive 
myopia. Metacognitive myopia refers to the apparently universal human 
inability to correctly evaluate the source, reliability, and validity of informa¬ 
tion we receive from others. Many reasoning deficits fail to be corrected 
at the metacognitive level, often indicating failures to monitor and control 
for the validity of incoming information, rather than simple failures of per¬ 
ception, encoding, memory, or information processing (Fiedler, Chapter 7 
this volume). The role of metacognitive myopia as a contributing source of 
gullibility is still insufficiently recognized in psychology, as little attention is 
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given to the metacognitive task of monitoring and deciding what informa¬ 
tion to use or to ignore. 

It turns out that judgmental errors often arise not because people are 
unable to process the information, but because they continue to accept 
and use false, misleading, unrepresentative, or even previously discredited 
sources of input. Most research concerned with heuristics and biases, includ¬ 
ing anchoring, representativeness, and availability effects (Kahneman, 2011; 
Kahneman & Tversky, 2000) tend to focus on faulty processing, neglecting 
the question of why humans seem unable to monitor, detect, and correct 
input biases. For example, people are notoriously poor in correcting for 
biased or unrepresentative sample sizes, and spurious experiences of repeated 
exposure to the same information will inevitably lead to the overestimation 
of the actual occurrence and validity of the event, even when judges are 
explicitly warned about such an effect (Fiedler, Chapter 7 this volume; see 
also Strack, Chapter 9 this volume). 


Toward an Integration 

As the previous sections show, there is now strong evidence in social and 
cognitive psychology showing that not seeing the world as it really is often 
turns out to be the baseline option for many human judgments. For a 
variety of reasons, evolution shaped human brains in such a way that they 
come equipped with information-processing programs that seem specifically 
designed to distort reality. While these “mind modules” may have been 
useful and adaptive in our ancestral environment, they can prove danger¬ 
ous and dysfunctional in modem mass societies where interpersonal trust is 
often misplaced, and false information is easier to come by than ever (see 
also Myers, Chapter 5 this volume). 

In the Stone Age context, where the world was stable and slow chang¬ 
ing, trusting the messages and “memes” coming from well-known others 
to enhance one’s limited experiences must have been of significant survival 
value, as most people were intimately known from birth to death, and as 
such, trustworthy. This is no longer the case in the modem, globalized world. 
Indeed, trust based on familiarity and the pressures of reputation began to 
erode with the spread of early cities, messages one gets from strangers or 
on the Internet are often explicitly designed to mislead us, for commercial, 
political, or personal reasons (see also Cooper & Avery, Chapter 16 this 
volume; Myers, Chapter 5 this volume). Human brains are poorly designed 
for fact checking, but are very good at accepting and incorporating second¬ 
ary information (see Fiedler, Chapter 7 this volume). 

These mental process, if not checked, can have very serious consequences 
in public life (see Cooper & Avery, Chapter 16 this volume; Myers, Chapter 
5 this volume). For the last 300 years, since the triumph of the Enlightenment 
in Western civilization and the advent of the scientific age, seeking “truth” 
has become an act of faith in Western cultures. It is not coincidental that 
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following the French Revolution, temples of “reason” and rational thinking 
were meant to replace conventional religion as the promoters of this religion. 
Philosophers like Spinoza, Hume, Bayes, and Pascal provided an epistemo¬ 
logical framework for truth-seeking, and a veritable army of well-qualified 
experts and scientists were engaged in the daily task of discovering and com¬ 
municating what is “true.” This system of truth-checking and truth-filtering 
now appears to be breaking down. The technological revolution we are now 
experiencing has removed any distinction between “truth” and “informa¬ 
tion,” and without expert filtering, any claim, by anyone, anywhere, about 
anything is now capable of reaching almost everybody on our planet. This 
book was designed to cover the latest research on many of the issues and 
processes we discussed so far in order to better understand contemporary 
gullibility. We shall now turn to a brief outline of the structure and contents 
of the book. 

Overview of the Volume 

Beyond this introductory chapter, the volume is organized into four comple¬ 
mentary sections, containing four chapters each. Part I deals with the nature 
and functions of credulity. In Chapter 2 Baumeister, Maxwell, Thomas, and 
Vohs suggest that gullibility frequently occurs as an evolutionary adapta¬ 
tion with distinct survival advantages. Evolution has shaped people to form 
lasting alliances, and this is promoted by overvaluing their partners (a form 
of gullibility). When in passionate love, people overestimate their partner’s 
positive qualities, and they themselves change so as to match those positive 
impressions. This is a largely unintentional process that evolution has shaped 
because it improves pair bonding and reproductive success. Men may be 
especially gullible in terms of entering into a long-term commitment based 
on false assumptions about the level of expected rewards. 

Chapter 3 by Unkelbach and Koch shows that even though people often 
seem gullible according to standards of logic and rationality, these errors are 
often adaptive. The chapter highlights the tension between people’s gullibil¬ 
ity and their nevertheless high functioning using the example of information 
repetition in the formation of beliefs. Although mere repetition increases 
the apparent truth of information, from a functional perspective, believing 
repeated information may actually have adaptive advantages. 

In Chapter 4 Douglas, Sutton, and Cichocka analyze the factors that attract 
people toward conspiracy theories and suggest that conspiracy beliefs are often 
driven by epistemic, existential, and social motives. Their review shows that 
people who believe in conspiracy theories will not simply believe anything 
they hear, but focus on conspiracy theories that appeal to important functional 
psychological motives. Thus conspiracy believers should not simply be dis¬ 
missed as gullible, even though such beliefs may often distort reality. 

In Chapter 5 Myers looks at how psychological science can contribute to 
our understanding of gullibility in public affairs. He surveys a broad range 
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of evidence illustrating how misinformation and direct lies shape politics 
resulting in public beliefs about crime, migration, the economy, or climate 
change. Social-cognitive dynamics such as the persuasive power of mere 
repetition, the availability heuristic, confirmation bias, self-justification, sta¬ 
tistical illiteracy, group polarization, and overconfidence all contribute to 
these effects. The role of objective, truth-supportive and evidence-based 
scientific scrutiny and education, and the promotion of critical thinking is 
also discussed in counteracting these effects. 

Part II contains four chapters dealing with the role of cognitive pro¬ 
cesses in gullibility. Chapter 6 by Krueger, Vogrincic-Haselbacher, and 
Evans offers a conceptual overview of issues related to gullibility in order 
to ground it in psychological science. They consider gullibility from vari¬ 
ous perspectives on inductive reasoning (Humean, Bayesian, Pascalian). 
Although gullibility can be easily represented as a special case of heuristic 
reasoning and predictable irrationality, it is more difficult to embed gullibil¬ 
ity in a theory that describes successes and failures of reasoning under lawful 
conditions. The issue of irrational trust plays an important role in explaining 
the cognitive mechanisms that produce gullibility. 

In Chapter 7 Fiedler proposes the term “metacognitive myopia” to 
describe the common inability to evaluate the history, reliability, and valid¬ 
ity of incoming information. Such naive reliance on received evidence irre¬ 
spective of its source (gossip, hearsay, advertising, anecdotes) persists even 
when bias is obvious. The chapter reviews extensive evidence for meta¬ 
cognitive myopia showing that people are often unable to ignore irrelevant 
information, make inferences based on unrepresentative samples, and ignore 
base rates. Metacognitive myopia suggests that gullibility is not simply the 
product of faulty reasoning, but is caused by an inability to monitor and 
evaluate information sources, and points to the social responsibility to mon¬ 
itor and control our judgments at the metacognitive level. 

In Chapter 8 Mayo explores the role of gullible versus skeptical mindsets 
in producing credulity. She reviews empirical research showing that incom¬ 
ing information can be processed using either a gullible mindset in which 
acceptance is the primary process or a skeptical mindset in which rejection 
is the primary process. Her research shows that the skeptical mindset offers a 
strong and successful negation process that diminishes gullibility such as false 
memory and misinformation effects. Contextual cues or personality disposi¬ 
tions may induce a skeptical mindset, and mindsets may fluctuate from one 
moment to the next, depending on individual differences and context. 

In Chapter 9 Strack discusses the role of social comparison processes in 
promoting gullibility. Social comparison can be driven by the motivation 
to leam from others (upward comparison) or boost one’s own self-esteem 
(downward comparison). From a cognitive perspective, comparisons can 
influence judgments by activating standards and standard-consistent infor¬ 
mation that selectively increase the accessibility of some information. 
Within the domain of behavioral economics, facilitating comparisons may 
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affect people’s utility assessments. Apparent gullibility may be due to such 
judgmental dynamics as illustrated by experimental results. 

Part III of the volume features chapters dealing with affective and moti¬ 
vational processes in gullibility. Chapter 10 by Forgas explores the role 
of sub-conscious affective states and moods in producing gullibility. He 
describes several psychological mechanisms responsible for mood effects on 
gullibility and skepticism. A series of experiments are described showing that 
mild negative moods can decrease gullibility, including greater skepticism in 
truth judgments, reduced willingness to believe misleading information, the 
improved detection of deception, and reduced “bullshit” receptivity. The 
theoretical significance of these studies is discussed, and the practical impli¬ 
cations of affectively induced gullibility will be considered. 

In Chapter 11 Macrae, Olivier, Falben, and Golubickis discuss how the 
self can bias information processing and gullibility. They suggest that the 
human mind may be easily deceived because it functions to optimize self- 
serving outcomes. For example, self-relevance is known to bias percep¬ 
tual judgments. The chapter describes a series of experiments that explore 
the effects of self-relevance and ownership on decision-making, and the 
cultural determinants of self-prioritization. These analyses demonstrate that 
self-referential processing can trigger response biases and irrational or gul¬ 
lible decisions and judgments. 

In Chapter 12 Dunning reviews an especially important phenomenon, 
self-gullibility, showing that people are particularly gullible as to their own 
capacities and beliefs. Research shows that people hold their opinions with 
too much confidence, endorse wrong answers with almost as much fervor 
as right ones, dismiss the opinions of others too much, and give greater 
credence to a belief when attributed to themselves. These failures are com¬ 
pounded by an inability to know when, how, and from whom to seek 
advice, and how to evaluate the quality of that advice. In order to overcome 
self-gullibility, people need to become more expert at weighing the cred¬ 
ibility of internal beliefs and outside information rather than relying on the 
strength of their beliefs as a proxy for their validity. 

Chapter 13 by Schwarz and Lee looks at a relatively little understood 
subliminal influence on credulity: olfactory signals. In most languages, sus¬ 
picion is metaphorically linked with the sense of a foul, rotting smell, a link 
that is presumably adaptive, suggesting an evolutionary link to disgust and 
rejection. The chapter reviews experiments showing that incidental expo¬ 
sure to a fishy smell makes people more suspicious and curbs gullibility in a 
number of tasks. These effects do not emerge in response to other aversive 
smells. The results are discussed in the broader context of cognition as a 
situated, experiential, embodied, and pragmatic process. 

Part IV presents chapters discussing the social and cultural aspects of gul¬ 
libility. In Chapter 14 Oyserman examines the role of cultural fluency in 
promoting gullibility. Being part of a culture means knowing what to expect 
and this experience of cultural fluency makes daily life feel easy to process. In 
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contrast, cultural disjluency arises in situations in which experiences mismatch 
predictions. Mismatch is a signal that elicits more deliberate thought. The 
cognitive ease arising from cultural fluency can increase credulity, and con¬ 
versely, exposure to cultural disfluency can reduce gullibility. 

In Chapter 15 Jussim, Stevens, Honeycutt, Anglin, and Fox look at one 
of the most embarrassing examples of gullibility: scientific gullibility, defined 
as cases when data or reasoning do not justify a scientific conclusion. The 
authors show that scientists, often influenced by ideological bias, frequently 
and systematically violate their own rules. This includes making unwar¬ 
ranted conclusions based on inadequate samples, presenting preferred opin¬ 
ions as facts not supported by data, engaging in motivated reasoning, and 
accepting evidence that supports preferred conclusions. They may fall prey 
to excessive scientism, assuming that a finding being published establishes it 
as scientific fact, and they may also fall victim to status quo bias, maintaining 
the scientific consensus. The chapter concludes with recommendations for 
limiting scientific gullibility. 

In Chapter 16 Cooper and Avery discuss an important social psychologi¬ 
cal aspect of gullibility: that communications should be reasonably truthful, 
that is, fall within an envelope of legitimacy. When propositions lie outside 
the envelope of legitimacy, an aversive feeling of gullibility may result that 
threatens people’s self-esteem. One way to reducing the discomfort is to 
“double down” on the false belief, convincing oneself that we have not 
been duped at all. In support of this hypothesis, Donald Trump voters who 
exhibited greater sensitivity to feelings of gullibility were significantly more 
likely to believe their candidate’s campaign promises, especially those that 
seemed most unlikely. 

Chapter 17 by van Prooijen looks at the social and psychological 
mechanisms that lead people to believe in conspiracy theories. Conspiracy 
believers often claim to be rational skeptics, and many conspiracy theo¬ 
ries feature very complex and well-articulated explanations. The chapter 
shows that reasonable skepticism is not a cause for conspiracy beliefs, as 
such beliefs correlate positively with other implausible paranormal and 
pseudoscientific beliefs and bullshit receptivity. Conspiracy beliefs also 
predict increased susceptibility to a cognitive biases, suggesting that belief 
in conspiracy theories is rooted in heuristic rather than analytic thinking, 
indicating dispositional gullibility. 

In summary, our aim with this volume is to contribute to a better under¬ 
standing of the social psychology of gullibility, an issue of considerable topi¬ 
cal relevance today. In this introductory chapter in particular we have tried 
to survey some of the most important historical, cultural, evolutionary, and 
psychological perspectives that may help to explain gullibility as a funda¬ 
mental characteristic of our species. The chapters were selected to offer a 
broad and representative overview of the most recent research develop¬ 
ments in this intriguing area. As editors, we are deeply grateful to our con¬ 
tributors for accepting our invitation to attend the 20th Sydney Symposium 
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of Social Psychology, and sharing their valuable ideas with our readers. We 

sincerely hope that the insights contained in these chapters will contribute 

not only to the emerging science of human gullibility, but also to a better 

understanding of the role that credulity plays in human affairs. 
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One ideal in Western civilization is that a man and a woman discover 
that they were meant for each other, fall deeply and mutually in love, 
marry, and spend the rest of their lives together. They support each other 
through good and bad times, raise a family, share life’s chores and burdens, 
and make each other happy, till death do them part. Love may change in 
some respects but lasts forever, expressed in kindness, concern, affection, 
and passionate, tender sex. 

Not everyone’s experience exactly lives up to that ideal. Yet the 
promise is powerful. The majority of young people say they want to 
marry (Wang & Parker, 2014), and most do (or at least enter into a long¬ 
term cohabitation; Stepler, 2017). Yet wedding vows promising lifelong 
devotion and fidelity will often be broken. Even though approximately 
40% of U.S. marriages end in divorce (Schoen & Canudas-Romo, 
2006), people are confident their own marriages will not reach the same 
fate (e.g., Fowers, Lyons, Montel, & Shaked, 2001; Klaczynski & Fauth, 
1996; Weinstein, 1980). Many people even recite such confident vows at 
their second and third weddings, when presumably they should already 
know better. How could any person marrying for the third time really 
believe to be together “till death do us part”? Yet some do. Someone is 
awfully gullible. 

This chapter considers forms of gullibility that help people make long¬ 
term commitments to romantic partners. The term gullibility is often 
used to refer to susceptibility to deliberate persuasion or deception (see 
also Cooper & Avery, Chapter 17 this volume; Krueger, Vogrincic- 
Haselbacher, & Evans, Chapter 6 this volume). That is not meant here. 
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We think men and women do mislead each other — but not knowingly 
or deliberately. Couples who managed to persuade each other that they 
were a great match may have left more offspring than their less gullible 
cohorts. In that way, romantic gullibility may increase reproductive fitness 
and spread through the gene pool. Our focus is not on intentional forms 
of deception in mating (such as faking orgasm; Kaighobadi, Shackelford, 
& Weekes-Shackelford, 2012), but rather on the subtle ways nature may 
mold people to present themselves as a better match than they truly are. 
Because we are taking an evolutionary approach, we focus here on hetero¬ 
sexual monogamous romantic relationships. 

Clearly the human form of mating is an evolutionarily radical inno¬ 
vation. Other great ape males do not enter into long-term committed 
relationships in which they provide resources to an adult female and her 
offspring. From the perspective of other primates, human males would 
seem remarkably gullible. 

Yet gullibility may be valuable, even crucial, for the species. Cooperative 
parenting is essential to our evolutionary and cultural success. The complex 
demands of human culture require a high level of intelligence and a large 
brain size, yet human infants must be born in a relatively altricial state to 
ensure passage of the head through the birth canal. It is only after a lengthy 
period of dependence on parents that a culturally competent adult emerges. 
Throughout much of human evolutionary, as a result of the greater biologi¬ 
cal demands of pregnancy and lactation on women occasioning prolonged 
periods of dependence on male support, the presence of a male providers 
significantly increased the survival fitness of their offspring. This depend¬ 
ence on male support has only recently been mitigated by the emergence 
of the welfare state in Western civilisations. In other words, humankind 
flourished because evolutionary sexual strategies and cultural norms set men 
up to be gullible enough to become long-term providers of resources to 
women and children. 

In particular, sexual attraction and love serve functions in humans that 
extend beyond what other primates do: They are useful for forming and 
cementing interpersonal bonds between the partners who may well become 
parents (see reviews by Bimbaum, 2014; Fisher, 1998; Fletcher, Simpson, 
Campbell, & Overall, 2015). In modem times, the bond is reinforced by 
societal commitments, such as religious and legal obligations, but the need 
for cooperative parenting predated these institutional pressures. 

Nobody is perfect, so mate selection requires the need to settle for 
an imperfect partner and make the best of it. Evolutionary theorizing 
assumes a large mating market with plenty of competition and a broad 
selection of possible mates. In practice, however, early humans (e.g., in 
hunter-gatherer societies for over 90% of human history) probably had 
relatively few options. If they were to reproduce, they had to select from 
among a very limited set of imperfect potential partners Committing to a 
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long-term relationship with a flawed other person requires some gullibility 
and optimistic distortion. 

Love and Irrationality 

Passionate love was for a time regarded as a peculiar invention of Western 
culture, but subsequent scholarship concluded that it is found all over the 
world (Jankowiak & Fischer, 1992; Neto et al., 2000), and so constitutes a 
universal human experience. Love forges strong attachments between men 
and women, which are vital for raising human children (e.g., Fisher, 1998; 
2004; 2006; Fisher, Aron, & Brown, 2006; Fletcher et al., 2015). 

Flumans seem to be evolutionarily predisposed to falling in love and 
maintaining lasting romantic pair-bonds. Feelings of euphoria, pleasure, 
arousal, compulsion, and addiction are dramatically increased by a roman¬ 
tic/passionate attraction (Fisher, 2004; Fisher, Xu, Aron, & Brown, 2016). 
Rejection and partner absence can send the person spiraling down to 
depression, doubt, anxiety, and jealousy (Baumeister & Wotman, 1992; 
Baumeister, Wotman, & Stillwell, 1993; Fisher et al., 2016). 

Behaviors in the throes of romantic love are often extreme and irrational. 
Some cultures and some historical eras have recognized passionate love as an 
irrational state (Stone, 1988) and this has been an important justification for 
arranged marriages. Choosing a life partner while passionately in love would 
be like choosing all one’s retirement investments while seriously drunk. 

There is a long-standing recognition that love distorts how one perceives 
the love object. Lovers see the ones they love in idealized fashion, ignoring 
or overlooking flaws while exaggerating good traits (e.g., Conley, Roesch, 
Peplau, & Gold, 2009; Murray & Holmes, 1993; Murray, Holmes, & Griffin, 
1996a, 1996b). Lovers regard their love objects as far more wonderful than 
do disinterested, objective observers (Barelds, Dijkstra, Koudenburg, & 
Swami, 2011) or even friends (Murray, Holmes, Dolderman, & Griffin, 
2000). Moreover, an ironic truth is that many of the idiosyncratic qualities 
that attract partners initially are often viewed as the partner’s worst flaws 
when the infatuation wears off (Felmlee, 2001; Pines, 1997). One may ini¬ 
tially love a partner’s relaxed laid-back attitude, only to later resent him ot¬ 
her for being irresponsible and unconscientious. 

If conventional wisdom is correct and love distorts objective assessment 
of one’s partner, this is one important form of gullibility. In a sense, nature 
has instilled a temporary state of gullibility into humans, so that they over¬ 
estimate the quality of potential partners when deciding whether to enter 
into a long-term relationship. Obviously, idealizing the partner will increase 
the chances of commitment (see also Fletcher & Kerr, 2013; McKay & 
Dennett, 2009). 

How the long the idealization lasts is debatable. One line of evidence 
in support of idealization is the pattern of partner-serving attributions 
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(Bradbury & Fincham, 1990; Fincham & Bradbury, 1993; Holtzworth- 
Munroe & Jacobson, 1985), such as taking credit for success and deny¬ 
ing blame for failure (e.g., Mezulis, Abramson, Flyde, & Flankin, 2004; 
Zuckerman, 1979). People in strong loving relationships make attributions 
in ways that make the partner look even better than the self. This strat¬ 
egy is a useful aspect of sustaining a positive relationship (McNulty, 2010; 
McNulty, O’Mara, & Karney, 2008). People in troubled relationships do 
not show these patterns of partner-serving attributions (e.g., Fincham, 
Beach, & Baucom, 1987). Thus, if passionate love makes people idealize 
their partners, their cognitive strategies help to construe events in ways that 
maintain that idealized view. 

The Mask of Love: Helping Gullibility Along 

What natural selection presumably favored were cases in which a man and 
a woman forged a strong and lasting bond to each other, which sustained 
them through raising children into adulthood. Moreover, in the evolu¬ 
tionary past there were often not many alternative available partners: The 
hunter-gatherers did not have Match.com or eFlarmony, nor did the early 
farming villagers, so they had to choose a mate from among a limited set of 
locally available candidates. When people have to settle for someone who is 
far from ideal, it helps to have gullibility. Love accomplished this partly by 
making the lovers see each other as better than they really are. This section 
develops the more radical idea that love has a second way of increasing mat¬ 
ing among imperfect people. Love may temporarily make someone actually 
become a better person - a temporary change that will increase one’s appeal 
to the potential partner. 

The term “mask of love” refers to behavioral and personality changes 
during passionate love that increase the person’s attractiveness. The person 
in love metaphorically (and unintentionally) puts on a mask that is far more 
attractive than the real face. The mask of love complements the perceptual 
biases that glorify the beloved person. To illustrate, if Harry loves Sally, he 
will see her as better than she really or normally is — and he becomes better 
than he really or normally is. If Sally is inclined to love him in return, then 
she too will become more lovable (thereby warranting his love all the more) 
and will see him in idealized form. Thus, each of them undergoes a double 
boost in attraction. Skepticism, the standard deterrent to gullibility, will be 
swept away (see also Dunning, Chapter 12 this volume; Mayo, Chapter 8 
this volume). 

Over time, individuals come to see themselves in the idealized way their 
partner does (Murray et al., 1996b). Research on the Michelangelo phenom¬ 
enon suggests that one’s romantic partners can help one become closer to 
one’s ideal version of oneself (Drigotas, Rusbult, Wieselquist, & Whitton, 
1999; see review by Rusbult, Finkel, & Kumashiro, 2009). 
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Combining the mask of love hypothesis with the Michelangelo effect 
suggests an intriguing form of human gullibility. When in love, Harry 
becomes temporarily a better person, and Sally’s attentions help move him 
toward actually being that better person. 

Still, sustaining this over a 50-year marriage must be difficult. 
Gullibility must therefore continue to help. When couples are commit¬ 
ted to one another, their standards shift to fit their partner’s existing 
characteristics (Fletcher & Kerr, 2013; Neff & Karney, 2003). In other 
words, if the mask comes off but you are already committed, you strive to 
be happy with what is actually behind the mask. From existing research 
it is hard to tell whether becoming the best version of oneself when in 
love is a permanent change. Because most studies rely on self and part¬ 
ner reports of traits, it is difficult to get an objective, unbiased assess¬ 
ment of partners’ true traits (e.g., Murray et al., 1996a; Neff & Karney, 
2003). Although self-concept may shift following relationship dissolution 
(Slotter, Gardner, & Finkel, 2010), there is no work on whether one’s 
personality reverts to pre-love levels. 

Longitudinal evidence shows that becoming involved in a romantic 
relationship is associated with lower alcohol and substance use (e.g., Rauer 
et al., 2016; Staff et al., 2010) and reductions in other undesirable behavior 
such as committing crimes (Barr & Simons, 2015). Passionate love appears 
to be a state of ongoing or frequent positive emotion. A cursory skim of 
Google images for “people in love” reveals abundant happy, smiling faces. 
The implication is that people in love exude positive emotion. Happier 
expressions make people more attractive (Golle, Mast, & Lobmaier, 2013), 
which would make them more appealing to partners. The smiling faces 
may also promote gullibility (see Mayo, Chapter 8 this volume) and reduce 
skepticism (Forgas, Chapter 10 this volume). 

The reduction in depressive symptoms and pervasive positive emotions 
seems eminently well designed to improve someone’s attractiveness in the 
mating market. Studies suggest that people generally dislike interacting 
with depressed people (e.g., Gotlib & Robinson, 1982; Hammen & Peters, 
1978). Depression is also related to poorer romantic relationship quality 
(Segrin, Powell, Givertz, & Brackin, 2003) and can burden one’s romantic 
partner (Coyne et al., 1987). Advice for getting others to like one typically 
emphasize smiling and showing positive emotion (e.g., Carnegie, 1936), 
and research on ingratiation confirms that positive emotions elicit liking 
(Jones & Wortman, 1973), as does humor (McGee & Shevlin, 2009). If 
being in love can reduce depression, it would facilitate bonding. 

Careful laboratory studies by Gonzaga, Keltner, Londahl, and Smith 
(2001) found that love functions as a commitment-enhancing device. The 
effects of love were different from merely feeling happy or sexual desire. 
Feeling love led to more affiliative nonverbal behaviors and increased mark¬ 
ers of commitment, such as trust, constructive conflict resolution, and mutual 
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influence. Love motivates approach behaviors toward the love object and 
produces expressive behaviors that signal commitment to the other person. 

Several other changes also involve gullibility (see next sections). The 
man in love should express how much he wants to improve her feelings and 
well-being. Once he has won her heart, however, his attention may shift to 
other priorities. This was one of the themes of Flaubert’s prototypical novel 
Madame Bovary (1886): At first, Charles was obsessed with winning the heart 
of Emma and making her happy, but after the wedding his interests shifted 
back to business and other matters. Emma was disappointed that his over¬ 
riding concern with her happiness proved so temporary. 

Perhaps even more important to the man is that he desires frequent 
and highly satisfying sex (Baumeister, Catanese, & Vohs, 2001; McNulty, 
Maxwell, Meltzer, & Baumeister, under review). The hypothesis that love 
increases female sexual desire seems uncontroversial, but we shall return to 
relevant evidence later in this chapter. 

Female Gullibility? 

Evolution works based on reproductive success. The analysis up until now 
has argued that human reproductive success depended substantially on 
forming lasting male—female partnerships, with women typically provid¬ 
ing direct care to children and men providing food and other resources to 
both. The next sections will discuss what sorts of gullibility would enhance 
reproductive success by making men and women enter into committed 
parenting partnerships. 

Gullibility is a negative trait, and we respect contemporary norms in 
social science that hold that attributing negative traits to women is offen¬ 
sive and sexist. Our focus has therefore been on male gullibility. However, 
it is useful to consider whether in some respects nature made women vul¬ 
nerable as well, as there is well-documented evidence for female vulner¬ 
ability to judgmental errors when it comes to mating decisions (Haselton 
& Buss, 2000). 

One issue relevant to our focus on sexuality concerns concealed ovula¬ 
tion. In most nonhuman primates, the female’s ovulation is readily apparent. 
This encourages sexual behavior that leads to reproduction. It is a long¬ 
standing puzzle as to why evolution favored concealed ovulation in humans. 

A gullibility explanation suggests that concealed ovulation makes women 
more willing to engage in sex even when they do not want to get preg¬ 
nant. In other words, concealed ovulation conceals the woman’s current 
impregnability from her. Our ape ancestors presumably knew when they 
were ovulating, because of overt physical signs. As human intelligence and 
the symbolic ability to represent the future evolved, early human women 
became able to anticipate what sex during ovulation could do to them: 
months of pregnancy, a very painful birth process, and years of caring for a 
dependent child. Sensible women might avoid all of that and confine their 
sex lives to times when definitely wishing to become pregnant, if that is 
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now their main motivation for wanting sex. But of course such women 
might not reproduce, so modern women are descended from those who 
were unable to tell whether they were fertile at the moment. Not knowing 
whether they are ovulating could also be regarded as a form of gullibility as 
elucidated by Dunning (Chapter 12 this volume). 

Concealed ovulation meant that women could act on their sexual desires 
in the (sometimes mistaken) hope that sex would be safe from pregnancy. 
Throughout history, all over the world, women have engaged in sex and 
become pregnant against their wishes (e.g., Finer & Henshaw, 2006; Sedgh, 
Singh, & Hussain, 2014). The rate of unplanned, unwanted pregnancies 
would be much lower if ovulation were marked by unmistakable physi¬ 
cal signs. Concealed ovulation has meant heartache and tragedy for count¬ 
less individual women, but nature of course rewards reproduction, and so 
hominins with concealed ovulation out-reproduced those who knew when 
they were at high risk of impregnation. 

Insofar as women use sex to entice men to form long-term relation¬ 
ships providing resources, then the woman would favor having sex with a 
man who seems a promising candidate. Above all, that would include him 
being in love with her. Phony declarations of love are sometimes consid¬ 
ered a common feature of male seduction efforts. Female gullibility might 
mean being susceptible to such declarations. Buss (1989) found that one of 
women’s principal complaints about men was that some of them declared 
love and interest in a lasting relationship — but then skedaddled after sex had 
been consummated. These cases presumably reflect a form of female gul¬ 
libility. Women are aware of the pattern and can be appropriately skeptical. 

Relevant findings by Ackerman, Griskevicius, and Li (2011) indicated 
that women reported feeling happier if their male partner first declared his 
love after sexual activity had occurred in a relationship rather than before, 
presumably because such declarations prior to sex were suspect. Men 
showed the opposite pattern, reacting more favorably to declarations of love 
prior to the commencement of sexual intercourse. Thus, women are often 
adaptively on guard against being gullible. 

Male Gullibility 

Our emphasis is on male gullibility, which is prominent in a mating con¬ 
text. The human male takes on a role and responsibility far beyond what 
most other primate males do, and he has to sacrifice and suffer a fair amount 
(though he also gets some benefits). He has to be rendered much more gul¬ 
lible than a chimpanzee or gorilla if he is to acquiesce in being a long-term 
steady provider of resources to his offspring (and even to their mother), as 
well as bodyguard and high-powered workhorse. 

In that sense, gullibility could have abetted the acceptance of these new 
obligations. Let us imagine that in some prehistoric time, half the men were 
strongly gullible to female enticements and readily succumbed to providing 
for them for decades, while the other men remained like other “sensible” 
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primate males and only sought food for themselves. From whom are today’s 
human population descended? The ones who provided well and reliably 
were heavily favored by the women as sex partners and hence left copious 
offspring, while the non-gullible ones frequendy removed themselves from 
the gene pool. Human men were heavily bred to be domesticatable and, 
well, suckers. 

Clearly one adaptation was also to select men who came to love their 
children. Again, this may be evolutionarily novel, as most apes show no such 
feelings. Loving their children should make the men more willing to continue 
providing resources and protection over many years. This will not seem to 
him a form of gullibility. The gullibility is perhaps most apparent to the man 
whose wife divorces him and minimizes his subsequent contact with his chil¬ 
dren, often while continuing to extract resources. Farrell’s (1993) observation 
epitomizes the man’s discovery of how gullible he has been: He wrote that 
many a modem American divorced man feels that he is working his life away 
to provide money for people (ex-wife and children) who hate him. 

Long-term emotional attachment to the woman would be another 
adaptation. The man may be so captivated by the experience of passion¬ 
ate love that he expects it to last forever and cannot understand why the 
woman no longer treats him with the heady mix of positive emotion, 
gratitude, hero worship, and sexual desire that marked their passionate love 
phase. If sufficiently gullible, he may cling on to his attachment to her and 
his love for her, even when objective observers could probably tell that all 
those positive things are gone for good. Research has found that men fall in 
love more rapidly than women (e.g., Ackerman et al., 2011), and women 
fall out of love more rapidly than men (Rubin, Peplau, & Hill, 1981). That 
pattern is consistent with the depiction of men as the more romantic — and 
more gullible — gender. Women initiate more divorces than men (Hewitt, 
Western, & Baxter, 2006; Kalmijn & Poortman, 2006), and men suffer 
poorer physical and mental health after divorce than women (Kolves, Ide, 
& De Leo, 2010; Robards, Evandrou, Falkingham, & Vlachantoni, 2012) - 
again suggesting that men remain emotionally attached for longer. Male 
gullibility may thus be reflected in remaining emotionally attached to a 
woman beyond the point that is good for the man. Further supporting 
this notion is evidence that men report more experiences of unrequited 
love in young adulthood relative to experiences of mutual love, and more 
unrequited love than women (Hill, Blakemore, & Drumm, 1997; see also 
Baumeister et al., 1993); again suggesting men may naively remain attached 
to unreciprocating women. 

One extension of this argument suggests that men’s sense of fairness 
also constitutes a useful vulnerability. Whether women and men think 
differently about morality has been debated (cf. Gilligan, 1982; Jaffee 
& Hyde, 2000), but there is an empirical case that males are more con¬ 
cerned with abstract rules than females are. Gilligan (1982) noted that 
boys have developed complex group games with complex rules, and 
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carry on debates about rules at an abstract level. In contrast, girls play 
less complex games, and if there is a dispute, the game ends abruptly and 
without resolution. Benenson (2014) found that girls’ own games typi¬ 
cally are no more complex than taking turns in jump-rope. When playing 
games borrowed from boys, girls show considerably less interest in rules 
(especially debating the rules). The reason might be that males evolved 
to work in larger groups with fairly shallow relationships, so that group 
performance depended on fairness and abstract rules. If so, then man’s 
greater respect for notions of fairness makes him vulnerable to female 
requests couched in terms of fairness. 

A meta-analysis on gender and cooperation by Balliet, Mulder, and van 
Lange (2011) found that there was no overall gender difference in coop¬ 
erativeness and cooperative behavior, the patterns differed. In particular, 
women showed low cooperation with other women, whereas both men 
and women cooperated with men. Moreover, in multi-trial economic 
games, the gender difference in same-sex cooperation increased over trials. 
Male willingness to cooperate can survive an occasional bad action by the 
partner, whereas female cooperation ends abruptly if the partner disap¬ 
points her (as with the playground games, noted earlier). This also dovetails 
with the fact that women initiate more divorces than men (Kalmijn & 
Poortman, 2006). 

Thus, another aspect of male gullibility may involve forgiving the occa¬ 
sional misdeed by the partner. This may have evolved to facilitate male-male 
cooperation but may be a form of gullibility in male—female relationships. 
Women have not developed such a pattern in their relationships with other 
women. From an adaptive perspective, a couple is more durable if at least 
one of them is inclined to forgive various misdeeds and conflicts. Prospects 
would be best if both partners are forgiving, but the benefit also arises from 
at least one being forgiving. 

Above all, male gullibility may be driven by high sexual attraction to the 
woman. High sex drive has been shown to lead to various irrational pat¬ 
terns, such as future discounting (Wilson & Daly, 2004), greater risk-taking 
in a card game (Baker & Maner, 2008) and in skateboarding (Ronay & von 
Hippel, 2010). When males are sexually aroused they are more willing to 
engage in morally questionable behavior to obtain sex, and more willing 
to engage in unprotected sex (Ariely & Loewenstein, 2006). Like other 
primates, the male’s primary interest in the female involves sexual oppor¬ 
tunity. The woman can exploit this to entice him in to a committed sexual 
relationship. Male gullibility leads to believing that the sexuality enjoyed 
during the passionate love phase will be permanent. 

Female Sex Drive as Mask of Love 

In very general terms, men want sex from women. Women want long¬ 
term commitments from men. An ideal solution would be for the woman 
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to have boundless sexual desire for the man, who then gladly continues to 
provide resources. However, this may not be possible. In particular, once 
the relationship is established, the woman’s energy may turn to focus on 
the children, so frequent sex may be an unaffordable distraction. This is 
consistent with theorizing that sexual desire serves to bond individuals long 
enough for both partners to raise their children together (Birnbaum, 2014; 
Bimbaum & Finkel, 2015; Hazan & Zeifman, 1994, 1999). 

The core hypothesis here is that female sexual desire is in substantial part an 
adaptation to facilitate recruiting a male provider, that is, attracting him to form a 
long-term relationship in which he will provide for her. Once in this rela¬ 
tionship, there is less use for female sexual desire, so it may diminish, having 
served its main function. There is indeed evidence that increased female 
sexual activity may serve to accomplish females’ ultimate goal of securing 
partner resources (Rodriguez-Girones & Enquist, 2001). Women are more 
likely to initiate sex if their partner is less invested in the relationship (Grebe, 
Gangestad, Garver-Apgar, & Thornhill, 2013). Taken together this evi¬ 
dence suggests that it was functional for a woman to have high desire early 
on in a relationship to promote her partner’s commitment. 

There are competing theories about female orgasms. Although all female 
mammals have a clitoris and are thus capable of sexual pleasure, and a few 
animals have been stimulated in the laboratory to the point of vaginal con¬ 
tractions, there is not much evidence of frequent orgasms occurring in the 
wild among nonhuman animals, and the brief, fairly rough nature of much 
animal copulation seems poorly suited to produce female orgasms. Human 
women may not be the first animals to have female orgasms, but they cer¬ 
tainly have far more than other animals. There are various theories about this 
(see review by Puts, Dawood, & Welling, 2012), some of which emphasize 
the value of female orgasm for cementing bonds between man and woman 
(e.g., Eibl-Eibesfeldt, 1989; but see also Zietsch, Miller, Bailey, & Martin, 
2011). The orgasm may intensify the woman’s positive feelings and love for 
the man, and this may be reinforcing to him. This is likely multiplied by 
the human innovation of face-to-face intercourse. Face-to-face intercourse 
facilitates rapid and ongoing exchange of affection, including eye contact, 
talking, smiling, and kissing. One could say it seems well designed for turn¬ 
ing sex into love. 

In short, human evolution reshaped sexual intercourse in ways well 
suited to the communication of female pleasure to the man. This may well 
serve to strengthen the man’s love for the woman and to encourage him to 
make the long-term commitment. Indeed there is evidence that men report 
feeling more masculine if a female partner orgasms in an imagined sexual 
encounter (Chadwick & van Anders, 2017). Both genders acknowledge a 
female’s orgasm is a boost to the male’s ego (Salisbury & Fisher, 2014). 

Intense momentary pleasure is addictive to males. Men generally show 
much greater pursuit of such pleasures than women, including not just 
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sex but also obsessive involvement in music or sports, and even drugs. 
Men outnumber women in nearly all forms of alcohol and drug addiction 
(e.g., Brady & Randall, 1999; O’Malley & Johnston, 2002; Substance 
Abuse and Mental Health Services Administration, 2012). The male sus¬ 
ceptibility to the pursuit of remembered pleasure is another key aspect of 
male gullibility and may have evolved to facilitate men becoming attached 
to their female sex partners. 

The key point is that the communication of passionate sexuality is part of 
the woman’s mask of love. That is, nature has selected in favor of women 
feeling and showing a strong sexual response for the sake of forming a long¬ 
term relationship. It almost appears as if high sexual desire and orgasmic 
responsiveness might be a transitory phase associated with securing a long¬ 
term provider. They are for closing the deal, not a permanent part of the 
deal. And he may not realize this (thus he is gullible). 

Men may not always realize that in some cases, female sexual passion 
is a temporary condition perhaps designed by nature to entice him into 
a provider role. This is a key aspect of male gullibility. Presumably he 
believes that sex with her will always be the way it is during this passionate 
phase: thrilling, mutual, satisfying, and frequent. Indeed, a recent study of 
engaged men and women revealed that both sexes anticipated having sex 
approximately 11—12 times per month when married (Maxwell, Joel, & 
MacDonald, unpublished data), which is far above the typical frequency of 
sex in long-term relationships of once or twice per week (e.g., Blanchflower 
& Oswald, 2004; Call, Sprecher, & Schwartz, 1995). 

A crucial prediction of the viewing of female sexuality as instrumental is 
that female desire for sex will drop off once the man is committed. The first 
author’s own thinking along these lines was stimulated by Arndt’s (2009) 
book, The Sex Diaries. Arndt, a journalist and sex therapist, developed a plan 
for a racy bestseller based on having an assortment of couples keep diary 
records of their sex lives. When she perused the diaries, she did find some 
titillating scenes. But far more frequent were scenes of men begging and 
groveling for sex, while the women refused and sometimes developed elab¬ 
orate stratagems for avoiding sex. For example, one confided to her friends 
that it was often useful to start a small argument with her husband late in 
the evening, which would preempt any romantic mood or sexual overtures. 
Arndt concluded that some mysterious process causes many women to lose 
interest in sex as soon as they setde into a long-term relationship. 

Archival data provide some support for that conclusion. Ard (1977) 
surveyed married couples across many ages. The women typically thought 
their marriages had about the right frequency of sex, whereas the men 
wished for much more (indeed twice as much) sex as they were having. 
This suggests that many couples adjusted their sexual frequency to the 
lower rate of desire by the wife. The feminist movement has encour¬ 
aged women to be much more assertive about insisting that the husband 
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should wait for sex until the woman wants it too - which happens to be 
much less often. This change in behavioral expectations may well increase 
the need for couples to re-negotiate and re-defme what they consider an 
acceptably coordinated and mutually acceptable sexual pattern. A survey 
by Byers and Lewis (1988) found that half their couples had a sexual 
disagreement at least once per month. They found no cases in which the 
wife complained about not enough sex. That was always the husband’s 
complaint. Likewise, a survey of couples in sex therapy found that lack 
of sexual interest was a common problem among wives but rare among 
husbands (Hawton & Catalan, 1986; see Baumeister, Catanese, & Vohs, 
2001, for broader review). 

Probably the most thorough and rigorous data come from a pair of recent 
longitudinal studies that tracked newlywed couples across the first few years 
of marriage (McNulty, Maxwell, Meltzer, & Baumeister, under review). 
All couples began the study either just before or within a few months after 
their wedding day and were surveyed about twice per year for about five 
years. Right after the wedding, the men reported higher sexual desire than 
the women, but the difference, although significant, was not large. Over 
the subsequent years, the men’s desire remained at about the same level - 
while their wives’ sexual desire declined markedly and steadily. The effect 
remained significant after controlling for a host of other variables. In par¬ 
ticular, it remained significant after controlling for childbirth, although 
childbirth increased the effect. This fits the view that once the woman has 
children, her energies are focused on childrearing rather than on her sex 
life with her husband. But even if she does not have children, her sex drive 
declines once the man is committed. 

Why do men stay committed, once the wife loses interest in sex? One 
speculation is that natural selection has bred men to become addicted to 
powerful sources of pleasure, so that they continue to seek and expect sat¬ 
isfaction even as it dwindles. Another powerful insight was suggested by 
Cooper and Avery (Chapter 16 this volume), who note that when gulli¬ 
ble people begin to think they have been duped, they “double down” on 
their commitment — that is, they believe ever more fervently in what the 
evidence suggests may have been a mistake, a kind of dissonance reduc¬ 
tion effect. If the double-down hypothesis is correct, then when a man 
starts to realize that his wife is not acting like the sex goddess he perhaps 
rather naively and gullibly envisioned, this may well result in an inten¬ 
sification of his belief and expectation that eventually she may perhaps 
again become that (or, as he sees it, go back to being that; see Baumeister, 
Catanese, & Vohs, 2001). He may remain fixated on how wonderful it 
was before, and he fails to realize that things have changed - consistent 
with many patterns in which people do not realize that their knowledge 
is flawed or inadequate (see Dunning, Chapter 12 this volume; Fiedler, 
Chapter 7 this volume). 


The Mask of Love and Sexual Gullibility 33 


His and Her Gullibility 

Our overarching hypothesis is that nature has instilled gullibility into men 
and women to bind them together. The mask of love hypothesis suggests 
that during the peaks of romantic attraction, men and women actually 
change so as to become more appealing partners to each other, in addition 
to viewing each other in idealized manner. Part of the female mask of love 
involves high sexual passion. This reflects the female’s changes during love 
as well as the man’s vulnerability to believing it will always be like this. The 
gullible male forms a strong attachment and provides her with resources 
for years to come. 

In effect, nature has arranged a kind of “bait and switch” process that, 
like its marketing equivalent, functions to tempt people into commit¬ 
ments that they might not choose if fully informed and that can operate 
to their detriment. The mask of love entails that the person one comes 
to love and marry is not the same as the person with whom one ends up 
married, and the actual partner is a less appealing version than what one 
thought one was getting. The temporary flowering of the female sex drive 
is merely one of the more salient and problematic forms of the mask of 
love. But insofar as nature’s goal is to promote reproductive success via 
partnered parenting, it works. 

“Bait and switch” is legally prohibited in commerce as a deliberate decep¬ 
tive technique, and we do not think that most men and women are delib¬ 
erately deceptive. The term is used as an imperfect analogy. Still, it does 
introduce an economic perspective on mating. Before closing, we develop 
the economic analysis further. 

Sexual Economics and Different Understandings 

The mismatch in sexual desire that emerges over the early years of mar¬ 
riage points to further forms of gullibility in both men and women. When 
they negotiate and commit to a long-term relationship, they may have 
different understandings of what the commitment involves, even just in 
terms of sex. Both man and woman may exhibit some gullibility, albeit in 
different forms. 

A conceptual scheme for analyzing these sexual negotiations is sexual 
economics theory. This is a decidedly unromantic approach to analyz¬ 
ing love and sex, but a vast amount of evidence fits it, as reviewed by 
Baumeister and Vohs (2004). The core idea is that sex functions as a resource 
or service that men want from women, and so men must give women 
some other resources in exchange. Male sexuality has no exchange value, 
whereas female sexuality can be traded for many things women want: not 
just money but also food, attention, drugs, respect, career advancement, 
forgiveness, reduced punishment for misdeeds, high grades for academic 
work, and more. 
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The theory was originally focused on forming a new sexual relationship, 
or commencing to have sex for the first time even if that is also the last time. 
Its applicability to marriage is unclear. In modem marriage, the wife already 
owns all the husband’s assets (jointly), so there is not much more he can give 
her, thus there is no economic reason for her to give him sex. Insofar as her 
sex drive is based on extracting resources from him, it has no more utility 
once he has made a permanent commitment. 

A revealing insight emerged from recent research on female competi¬ 
tion. Women pass along gossip about their rivals, especially attractive ones 
(Reynolds, Baumeister, & Maner, in press). The content of the gossip is that 
the target woman is sexually unrestricted, that is, has plenty of sex with dif¬ 
ferent partners. That seems to clash with the sexual economics analysis. To 
discredit a competitor, they say that she has a low price. Hardly any busi¬ 
ness marketers advertise that their rivals have lower prices. Why would this 
occur in the human mating market? 

To resolve this dilemma (see Baumeister, Reynolds, Winegard, & Vohs, 
2017), it is necessary to consider what is being traded. Sexual economics 
theory began by assuming that sexual intercourse and pleasure were what 
was traded. But human mating commitments often involve exclusivity, and 
female more often than male exclusivity. The man thinks he is getting sex, 
augmented by her promise of faithfulness. Perhaps she thinks the main thing 
she offers is exclusivity, augmented by a little bit of sex. 

The couple can conceivably function just fine despite this difference in 
perspectival emphasis. They can make their commitment to each other, 
form a household as a cooperative team, start a family, and so forth. 

However, the emerging sexual mismatch brings these different under¬ 
standings to the fore. The man thought there would be plenty of sex, but his 
wife only wants to have sex occasionally. Many wives would be fine if sex 
were to stop altogether. Arndt (2009) told one story of a couple in which the 
man tried many different ways of initiating sex but received only angry rebuffs 
from his wife. Frustrated and exasperated, but trying to be respectful, he pro¬ 
posed that he should not be the one to initiate sex — that is, the next time they 
had sex would be up to her to initiate it. Nine years later, he was still waiting. 
For men in such a position, the marriage vow is a vow of chastity. 

To the husband, then, it may seem that the wife is reneging on the deal. He 
married her partly in expectation of lots of sex, but she is not providing that. 

From her perspective, however, she is fulfilling her part of the bargain 
that she would not have sex with anyone else, and she is succeeding at that. 
From her perspective, fidelity counts. That is precisely what she promised 
at the wedding. The church ceremony contained no vows about having sex 
when she did not desire it. During the passionate courtship, she felt abun¬ 
dant desire, but nowadays, not so much. Her sexual commitment likely 
assumed that sex would occur by mutual desire, not as an obligation. In 
sex, engaging in acts when one does not desire them has many negative 
connotations (e.g., Impett, Peplau, & Gable, 2005; Smith, 2007). As the 
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woman fails to appreciate that her desire for her partner will dwindle over 
time she may not realize that sex will start to become more of a chore and 
less of a delight. 

It is even possible that she thinks that he is the one who is not living 
up to the deal. If he accepts her unwillingness to have sex, he may resort 
to pornography and other outside stimulations — which to her may be 
a betrayal of the more important form of their commitment, namely to 
forsake all others. There are reports that some women object to their hus¬ 
band looking at pornography (e.g., Bridges, Bergner, & Hesson-Mclnnis, 
2003), although admittedly women have a range of attitudes regarding 
their husband’s porn use (Kohut, Fisher, & Campbell, 2017; Zitzman & 
Butler, 2009). Of course, many wives object to their husbands having sex 
with prostitutes or mistresses, even if the wife herself is largely disinclined 
to have sex. This is a moral and pragmatic dilemma: His partner is not 
interested in sex, but she objects to him finding alternative outlets. She has 
all but stopped sexual activity but his sex drive remains as strong as ever. 

The problem thus arises because of bilateral gullibility. Each partner 
promises something and expects something in return, but these expecta¬ 
tions do not quite match. The young couple in love are both happy with 
what they have and want to make it permanent, but they have different 
understandings of what it is they are making permanent. 

Conclusion 

Sexual gullibility is plausibly an innate tendency in humankind, because 
it likely improved reproductive success. It works differently in men and 
women. The gullibility helps them form a lasting attachment, which is opti¬ 
mal and adaptive for the babies that come along as a result of their having sex. 

We emphasize again that the gullibility patterns do not at all imply delib¬ 
erate deception. The mask of love hypothesis holds that these changes in 
behavior seem to occur naturally when in love, and the individual may 
not realize the misjudgment involved (see also Dunning, Chapter 12 this 
volume; Fiedler, Chapter 7 this volume; Krueger et al., Chapter 6 this 
volume). Powerful positive feelings may also increase gullibility (see also 
Forgas, Chapter 10 this volume). We suspect the wife may be as baffled as 
her husband at her loss of desire for sex across her early years of marriage. 
Explanations may focus on the stresses on her or on the newly visible faults 
in her husband (e.g., Sims & Meana, 2010). It is rarely realized that her high 
initial sexual response would have given him a misleading picture of what 
their future holds. In parallel, the man in love does everything to make her 
happy, and this too misrepresents what he might be as a husband. Neither 
are aware of their own fakery. 

To commit to spending the rest of one’s life with an imperfect person who 
may change in unpredictable and possibly unwelcome ways requires a major 
leap of faith, and a high degree of gullibility. Couples who successfully did this 
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left a larger footprint in the gene pool than those who avoided such a risky 
and dubious commitment. We have proposed that both men and women 
have been shaped by nature to be gullible so as to overestimate their partner’s 
positive qualities during the commitment phase (passionate love). 
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When considering how people come to form beliefs about the world 
they live in, they seem to be rather gullible (see Forgas & Baumeister, 
Chapter 1 this volume). People are convinced by weak arguments (Petty & 
Cacioppo, 1986; Petty, Wells, & Brock, 1976), they do not weight infor¬ 
mation properly (Dawes, 1979), and most critically, they fail to discount 
irrelevant information when forming beliefs (see Wilson & Brekke, 1994, 
for an overview). One of the most notorious ways people are influenced 
by irrelevant information is mere repetition. On first sight, simply repeat¬ 
ing information should not change its informational value, should not 
increase its validity, change its veracity, or increase its influence on people’s 
beliefs. However, simply repeating information does increase its subjective 
truth (Hasher, Goldstein, & Toppino, 1977; see Dechene, Stahl, Hansen, 
& Wanke, 2010, for a review). This seemingly irrational tendency was 
already discussed and acknowledged by Wittgenstein in his Philosohpische 
Untersuchungen [Philosophical Investigations] (1955/1977). Wittgenstein 
famously stated that repeating informational input does not help to ascer¬ 
tain that information, and one cannot “buy several copies of the morning 
paper to ensure that the content is true” (p. 147). Similarly, Begg, Anas, 
and Farinacci (1992) stated that “there is no logical reason for repetition 
to affect rated truth or for earlier information to be trusted more than later 
information” (p. 447). 

Repetition may thus seem “empty” from philosophical and logical per¬ 
spectives; however, from a psychological perspective, repetition is a key 
element in learning and memory (Ebbinghaus, 1885/1971; Hintzman & 
Block, 1971; McClelland, McNaughton, & O’Reilly, 1995). It increases 
the subjective value of stimuli (Betsch, Plessner, Schwieren, & Giitig, 2001; 
Unkelbach, Fiedler, & Freytag, 2007; Zajonc, 1968), and it establishes and 
strengthens perceived links between stimuli as in associative and evaluative 
learning (De Houwer, Thomas, & Baeyens, 2001; Rescorla & Wagner, 
1972). Considering this substantial impact of repetition on many psycholog¬ 
ical processes, it is less surprising that repetition also influences how people 
judge information’s truth and impacts personal beliefs. 
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In experimental psychology, the phenomenon that simply repeating 
information increases its subjective truth (Dechene et al., 2010; Hasher 
et al., 1977) is labeled the repetition-induced truth effect. This truth effect 
and its influence on the formation of beliefs is an empirically robust effect 
(see Dechene et al., 2010, p. 239) and believing in the existence of this 
effect is certainly not a form of scientists fooling themselves (see Jussim, 
Stevens, Honeycutt, Anglin, & Fox, Chapter 15 this volume). It is also of 
great practical interest. For example, when information is ever more often 
shared, reposted online, or multiplied via social media, the increase in sub¬ 
jective truth due to mere repetition may explain the apparent increase in 
evidently false beliefs (see Myers, Chapter 5 this volume). Prominent exam¬ 
ples are conspiracy theories (e.g., “9/11 was an inside job”; “Vaccinations 
cause autism”; see Douglas, Sutton, & Cichocka, Chapter 4 this volume; 
van Prooijen, Chapter 17 this volume), urban legends (e.g., “The hoover 
dam is built with dead bodies”; “Children tattoos contained LSD in the 
1960s”), but also single pseudo facts (e.g., “The Great Wall of China is vis¬ 
ible from the moon”) or “fake” news (e.g., “FBI agent suspected in Hillary 
[Clinton] email leaks found dead in apartment murder-suicide”). Due to 
repetition, these statements might become more believable. 

In the following, we will first provide examples of the effect and then 
explain its theoretical backgrounds. Based on these backgrounds, we will 
argue that repetition-induced truth has sometimes detrimental effects on 
what people believe to be true (e.g., pseudo facts, or “fake” news; see Myers, 
Chapter 5 this volume) when repetition comes from symbolic observations 
(e.g., social media, television, radio). Yet, we will argue that psychologi¬ 
cally functional to believe repeated information more than novel information 
when repetition is based on direct observations. 

Repetition-Induced Truth 

The idea that repetition is a key variable in persuasion, subjective truth, and 
ultimately, the formation of beliefs about the world, is well recognized, not 
only in psychological journals. The classic treaty The Crowd: A Study of the 
Popular Mind by Gustave Le Bon (1895/1996), already stated: 

It was Napoleon, I believe, who said that there is only one figure in 
rhetoric of serious importance, namely, repetition. The thing affirmed 
comes by repetition to fix itself in the mind in such a way that it is 
accepted in the end as a demonstrated truth. 

(Le Bon, 1895/1996, bk II, 
ch. Ill: 2, n.p., italics added) 

Similarly, in Aldous Huxley’s (1932/2008) novel Brave New World, chil¬ 
dren are taught not only knowledge, but also moral lessons by repeating 
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the same notions time and again while they sleep: “Sixty-two thousand 
four hundred repetitions make one truth (p. 47). And in general, people 
use the notion that repetition indicates information’s truth with the simple 
rule of thumb that if they have learned something somewhere before, it is 
likely to be true. For sure, if someone remembers reading the information 
in the Encyclopedia Britannica, it is well justified to believe this information is 
true. However, as we will see, repetition effects extend well beyond what 
can be rationalized so easily. Repetition also influences people’s beliefs if it 
comes from the identical source (“I told you, vaccinations cause autism”), 
if it is labeled as false (“It is false that vaccinations cause autism”), or even 
when the initial presentation is incompatible with the second presentation 
(“Vaccinations do not cause autism”; see below). So how does this strong 
influence of repetition on subjective truth and the formation of beliefs 
occur? Below, we provide a historical overview of the explanations for the 
repetition-induced truth effect. 

A History of the Repetition-Induced Truth Effect 

The Basic Effect 

Hasher et al. (1977) presented the first empirical evidence of the repetition- 
induced truth effect in the psychological literature, and their basic design 
is still prevalent today. Participants heard statements from a large pool of 
topics and different subjects during a presentation phase (e.g., “The thigh 
bone is the longest bone in the human body”) and were told that some 
of these are false and some are true. Factually, half of the statements were 
false, half were true. Two, four, and six weeks later, participants rated lists 
of “new” (not heard before) and “old” (heard before) statements on a scale 
from 1 (“definitely false”) to 7 (“definitely true”). They found higher truth 
ratings for repeated compared to new statements even up to six weeks later. 
However, they provided no direct evidence for a psychological mechanism 
but concluded that people use mere frequency to attribute validity (i.e., 
“truth”) to statements. 


The Recognition Explanation 

Going beyond the frequency-validity explanation, Bacon (1979) tested and 
offered the explanation that people may assign truth to repeated information 
simply because they remember the statements. Bacon showed that there is 
a correspondence between participants’ recognition judgments (i.e., “old” 
vs. “new”) and their rated truth; that is, whether they recognized a state¬ 
ment influenced the truth judgments. The data also contradicted the fre¬ 
quency explanation by Hasher and colleagues (1977) because the objective 
frequency status of a statement (i.e., repeated vs. novel) had less influence 
than the subjective repeated vs. novel status of that statement. Thus, Bacon 
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(1979) concluded that: “Consequently, the repetition effect is not really a 
repetition effect after all but a recognition effect” (p. 251). Please note that 
at this point, if recognition would be the sole correct explanation of the 
repetition-induced truth effect, then the effect would be indeed irrational 
and dysfunctional, as people might remember both lies and truths, and rec¬ 
ognizing a lie should not increase its subjective truth. It would also be irra¬ 
tional for people to judge statements to be true just because they remember 
them from an experimental session two weeks earlier; because two weeks 
earlier, they also learned that they might be true or false (see above for the 
basic paradigm). 


The Familiarity Explanation 

Arkes, Boehm, and Xu (1991) offered and tested two explanations for the 
repetition-induced truth effect. The first mechanism underlying the effect 
the authors labeled as referential validity. If two independent sources provide 
the same information, that is, repeated information, then the information 
is more likely true, just because it is very unlikely that two independent 
sources provide the same false information. This follows because statements 
can be false in many different ways while there is usually only one true 
version of a statement. This is particularly true when it comes to state¬ 
ments about the physical world (see Alves, Koch, & Unkelbach, 2017, for 
a more general version of this argument). For example, Budapest may be 
a city in Romania or Argentina or Turkmenistan (all false), while there is 
only one correct statement: Budapest is a city in Hungary. This reasoning is 
also employed forjudging the validity of eyewitness testimonies (i.e., two 
eyewitnesses independently reporting the same information makes it more 
likely true). It is also one of the most frequent strategies to assess validity 
when people search information online. For example, when two people 
independently praise the virtues of a given product in their reviews, or 
when two news sites independently report the same political events, they 
are more likely to be taken as true. For the repetition-induced truth effect, 
this implies that people recognize information but overlook that it comes 
from the same source as before (i.e., another experimental session rather 
than an independent outside source). 

However, across their experiments, Arkes and colleagues (1991) found 
only evidence for their second suggested mechanism, namely that subjec¬ 
tive familiarity with the statements determines judged truth. As familiarity 
also influences recognition judgments, subjective familiarity was a candi¬ 
date for replacing recognition (Bacon, 1979) as the underlying mechanism 
of the repetition-induced truth effect. People may believe information if 
it feels familiar. 

To pit recognition against familiarity, Begg et al. (1992) employed a 
so-called process dissociation procedure (see Jacoby & Kelley, 1992, for an 
easy introduction). Their participants heard statements from sources that 
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were labeled as “true” or “false”; for example, given a male and a female 
speaker, participants learned that all statements by the male speaker would 
be false, and all statements by the female speaker would be true. Begg and 
colleagues (1992) found that repeated, and thus, more familiar statements 
from a “false” information source were more likely to be judged as true 
compared to new statements. Repeated, more familiar statements from a 
“true” information source, however, were most likely to be taken as true. 
Thus, the authors concluded that both familiarity and recognition indepen¬ 
dently contribute to judged truth. 

The central role of familiarity was further supported by experiments 
showing that even statements labeled as blatant lies benefited from repeti¬ 
tion (Brown & Nix, 1996), or that even information (“Crocodiles sleep 
with their eyes open”) that directly contradicted the original information 
(“Crocodiles sleep with their eyes closed”) became more believable due to 
the repetition of the semantic content (Garcia-Marques, Silva, Reber, & 
Unkelbach, 2015). These effects should not occur if people would factually 
remember the original encounter or recognize the statements. 


The Fluency Explanation 

The experiments by Begg and colleagues (1992) placed the repetition- 
induced truth effect into the larger category of effects caused by experiences 
(here: familiarity) elicited by the stimulus, such as the mere exposure effect 
(Mandler, Nakamura, & van Zandt, 1987; Zajonc, 1968), the revelation 
effect (Watkins & Peynircioglu, 1990; see also Topolinski & Reber, 2010), 
the false fame effect (Jacoby, Kelley, Brown, &Jasechko, 1989), or process¬ 
ing ease effects (see Strack, Chapter 9 this volume). Further, Whittlesea 
(1993) proposed that information familiarity is not a direct output from 
memory, but results from the automatic attribution that fluent process¬ 
ing of the respective information is due to a previous encounter. Thereby, 
processing fluency, which is the experienced ease of ongoing mental pro¬ 
cesses (Unkelbach & Greifeneder, 2013), became a candidate as the central 
explanatory construct for the repetition-induced truth effect. 

Reber and Schwarz (1999) directly tested whether processing fluency 
(i.e., the experience of easy processing) influenced judged truth directly, 
without actually repeating information. Instead of repeating statements, 
they presented simple statements (e.g., “Osomo is a city in Chile”) in flu¬ 
ent, easy-to-read colors (e.g., dark red or dark blue) or disfluent, difficult- 
to-read colors (e.g., green and yellow). Indeed, participants rated statements 
in difficult-to-read colors as less true compared to statements in easy-to-read 
colors. Similarly, McGlone and Tofighbakhsh (2000) showed that people 
believe aphorisms that rhyme and are thus fluently processed (“Woes unite 
foes”) more than content-identical aphorisms that do not rhyme and are 
thus less fluently processed (“Woes unite enemies”). 
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Fluency as the central explanatory construct for repetition-induced 
truth was further supported by experiments by Unkelbach (2007), which 
addressed two critical points: First, they showed that the repetition- 
induced truth effect it is not a mere exposure effect. Second, it is indeed 
processing fluency that mediates the effect. Concerning the first point, if 
repetition-induced truth is indeed due to subjective experiences elicited 
by a stimulus (e.g., a statement “feels” familiar), it might not be a fluency 
effect, but rather a mere exposure effect (Zajonc, 1968, 2001). The mere 
exposure effect is the acquisition of preferences due to the repeated expo¬ 
sure to stimuli; in other words, people like repeated things. The repetition- 
induced truth effect may then follow simply because people like repeated 
information more than novel information and express this preference with 
a positive truth rating. Alternatively, people might employ a “positive, 
therefore true” heuristic (Unkelbach, Bayer, Alves, Koch, & Stahl, 2011; 
but see Hilbig, 2012). 

Unkelbach (2007) argued that fluency effects depend on the interpreta¬ 
tion of the fluency experience (see also Unkelbach & Greifeneder, 2013), 
and a truth effect follows because people interpret fluent processing as a 
cue for a statement’s truth. If people learn a different interpretation of pro¬ 
cessing fluency when judging truth (e.g., fluent processing as a cue for a 
statements falseness), a fluency explanation predicts that people should take 
repeated and thus fluently processed information as false instead of true. 
In contrast, mere exposure should unconditionally lead to higher rated 
truth of repeated information. Thus, participants encountered statements 
in a training phase for which truth correlated with their processing flu¬ 
ency. In a standard condition, truth and processing fluency were positively 
correlated; for example, true statements such as “Dolphins are mammals” 
were presented in dark blue or dark red and thus easy to read, while false 
statements such as “Lead is lighter than aluminum” were presented in light 
green or light yellow and thus difficult to read. In a reversed condition, false 
statements were easy to read and true statements were difficult to read. This 
latter condition reversed the color-based truth effect found by Reber and 
Schwarz (1999). In the following test phase, when participants judged the 
truth of easy or difficult to read statements, participants judged “easy” state¬ 
ments as false and “difficult” statements as true (see Olds & Westerman, 
2012, for similar fluency reversals). The training with colors also reversed 
the repetition-induced truth based on repeated and novel statements that 
were both printed in black against a white background; that is, the fluency 
training transferred from one fluency source (i.e., color contrast) to another 
fluency source (i.e., repetition). 

This finding clearly showed that it is people’s interpretation of process¬ 
ing fluency that underlies the repetition-induced truth effect; otherwise 
standard vs. reversed training with color should not influence the effect of 
repetition on judged truth. Further, mere exposure would have predicted 
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a main effect of repetition independent of standard vs. reversed training 
with color. Thus, processing fluency was established as the construct that 
explains both the repetition-based and non-repetition-based (e.g., color, 
rhyming) truth effect. 

Yet, empirically, non-repetition-based fluency manipulations usually 
yield smaller truth effects than repetition-induced truth effects. For example, 
Hasher and colleagues (1977) reported a truth effect of d = 0.84 for repeated 
compared to new statements (estimated from Hasher et al., 1977, Table 1). 
The color-based truth effect by Reber and Schwarz (1999) was substantially 
smaller, namely d = 0.13. With some exceptions (e.g., Unkeibach, 2007, 
Experiment 2), stronger repetition-based truth effects are apparent in most 
data sets (e.g., compare Hansen, Dechene, & Wanke, 2008, with Dechene 
et al., 2010). Obviously, this could be due to fluency effects from repeti¬ 
tion being stronger than fluency effects from, for example, color contrast. 
However, the pattern may also suggest that processing fluency and rep¬ 
etition influence truth via different processes. Addressing this issue, Silva, 
Garcia-Marques, and Mello (2016) directly compared perception-based and 
repetition-based fluency effects on truth and concluded that repetition and 
perceptual fluency influence truth judgments in different ways: “It seems 
that repetition has a stronger connection to truth, which is also less malle¬ 
able than in the case of perceptual fluency [. . .] truth effects due to percep¬ 
tual fluency are likely to have another origin” (p. 13). 

Thus, on a functional level, repeating information increases its believ- 
ability and subjective truth; on a process level, the specific cognitive mecha¬ 
nisms are still under investigation, and in the next section, we review an 
alternative explanation. While so far, repetition seems to be a path to gul¬ 
libility, the following also suggests potential adaptive functions of people 
believing repeated information in particular, and easily processed informa¬ 
tion in general. 


A Referential Theory 

Besides smaller truth effects based on perceptual compared to repetition- 
induced fluency, the fluency explanation necessitated additional assump¬ 
tions. In a nutshell: Why do people use fluency as a cue for truth rather 
than for falseness? One answer was provided by assuming that people learn 
to interpret processing fluency as “truth” (Unkeibach, 2006; Unkeibach & 
Greifeneder, 2013). For example, on the receptive side, people may learn 
that fluently processed information they hear is indeed true. Conversely, 
people may learn that telling the truth is easier (more fluent) than producing 
a lie. Another answer was that people have lay theories for the meaning of 
processing fluency (Greifeneder & Schwarz, 2014; Schwarz, 2004). That is, 
people either need to learn that fluent processing is indicative of truth, or 
they need a lay theory that makes the connection between truth and fluency 
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(e.g., “If it feels fluent, it must be true”). This is non-trivial because one 
must assume benevolent learning environments that allow the link between 
truth and fluency to establish, or a source of a metacognitive theory that 
establishes the truth—fluency link. 

To address the empirical difference between “pure” fluency effects and 
repetition-based fluency effects, and to address the additional assumptions 
about the source of the interpretation, Unkelbach and Rom (2017) pro¬ 
posed a referential theory of the repetition-induced truth effect. The theory 
starts from a philosophical point asking how people may in general judge 
the validity, veracity, or “truth” of a given piece of information. Most phil¬ 
osophical theories of truth incorporate two major elements for such judg¬ 
ments, namely correspondence and coherence (Kirkham, 1992). 

Simplified, correspondence is the relation of information with physical 
reality. For example, if one hears “Mary is taller than Paul” and observes 
that Mary is taller than Paul in reality, the statement is true. Psychologically, 
one may thus see correspondence as references in memory that provide 
meaning for the elements of a given statement; upon hearing “Mary is taller 
than Paul,” one may remember seeing those and judge the statement as true 
based on this reference in memory. 

Coherence is then the relational consistency of these corresponding ref¬ 
erences. For example, one may have never seen Mary and Paul together, 
but one may remember Mary is a relatively small woman and Paul is a 
relatively tall man. Thus, the references that provide meaning for the labels 
“Mary” and “Paul” in memory might be incoherent with the statement 
“Mary is taller than Paul.” 

Similarly, the statement “The world’s highest tree is a Sequoia tree in 
California” should have corresponding references in memory that provide 
meaning for the statement’s elements. Upon hearing the statement, most 
people will have memory references for the elements “world,” “Sequoia,” 
“tree,” and “California”; these elements correspond with physical real¬ 
ity. In addition, for most people, these corresponding references will be 
highly coherent. For example, California is a U.S. American state within 
the world, Sequoias are trees that grow in California, and Sequoias are also 
typically tall trees. Thus, the statement has corresponding references that are 
coherent and is thus likely to be judged as “true.” 

How correspondence and coherence may inform truth becomes appar¬ 
ent if one changes one element in the statement: “The world’s highest tree 
is a Sequoia tree in Antarctica.” Both statements have the same number of 
corresponding references. Yet, assuming that people have information in 
memory about California and Antarctica, the California statement is highly 
coherent, while the Antarctica statement is incoherent. Most people will 
have a memory representation of Antarctic that does not allow the growth 
of Sequoia trees. As a result, people on average should believe the California 
statement, but not the Antarctica one. Figure 3.1 illustrates this process. 
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Figure 3.1 Illustration of how correspondence and coherence determine subjective 

truth. The solid grey lines indicate incoming information; here, a statement 
about trees. The grey circles (“tree”) represent references in memory that 
provide meaning to the elements in the statement. Solid black lines indicate 
links between these references and the strength of the line indicates link 
strength. Dotted lines indicate links that are instigated by the incoming 
information. Finally, “plus” signs indicate an excitatory link and “minus” 
signs indicate inhibitory links. Coherence, defined as a parallel-constraint 
satisfaction solution (Kunda & Thagard, 1996), then defines the resulting 
subjective experience. If the statement’s corresponding references form a 
coherent network, a “true” response follows, while an incoherent network 
of references results in a “false” response. 

Source: Adapted from Unkelbach and Rom (2017, fig. la). 


Figure 3.2 then illustrates the implications of this referential process 
for the repetition-induced truth effect. When people hear or read a novel 
piece of information or a novel statement (illustrated by the light grey 
lines), as in the typical exposure phase of a truth experiment in the tradi¬ 
tion of Hasher and colleagues (1977), the statement activates correspond¬ 
ing references within memory (e.g., “California” etc.) and their respective 
links. For novel information in the statement (e.g., “Sequoia” for a person 
who does not know a Sequoia is a type of tree), a corresponding reference 
will be formed and — if no inconsistency is apparent — coherently linked 
to the activated corresponding references (“Sequoias are trees that grow 
in California”). In the subsequent test phase, repeated statements will thus 
have more corresponding references that are coherently linked (see the 
right panel of Figure 3.2) than new statements; this is why new statements 
will appear relatively less true than repeated statements. 
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“The world’s highest tree is a 


‘The world’s highest tree is a 

Sequoia tree in California.” 


Sequoia tree in California.” 



Figure 3.2 An illustration of the repetition-induced truth effect according to a 
referential explanation. The left panel shows the presentation phase 
when participants encounter a statement for the first time. If it is not 
incoherent with existing references (see Australia vs. Antarctica), the 
statement’s corresponding references are linked within memory, as 
shown in the middle panel. At test, all of the repeated statements’ 
elements are coherently linked, leading to a “true” judgment, as 
shown in the right panel. Novel statements at test are equivalent to 
the left panel. As the left panel has fewer coherently linked references 
compared to the right panel, a repetition-induced truth effect follows. 

Source: Adapted from Unkelbach and Rom (2017, fig. lb). 


A truth effect based on fluent processing without repetition then occurs 
because many corresponding references that are coherendy linked increase 
a statement’s fluency of processing; thus, fluency is also a function of the 
coherently linked corresponding references, rather than the ultimate expla¬ 
nation why repetition increases judged truth. Conceptualizing process¬ 
ing fluency this way solves the theoretical challenge of how people learn 
to associate fluent processing with truth. The referential theory assumes 
that people believe statements and judge them to be true when they acti¬ 
vate many coherendy linked corresponding references. As many activated, 
coherently linked corresponding references increase both subjective truth 
and subjective processing duency, people experience and leam that truth and 
fluency are correlated. This learned interpretation of processing fluency as 
a truth signal then leads to duency-based truth illusions when duency is 
manipulated independent of repetition (e.g., by color contrast or rhyming). 

It is also important to emphasize that the referential theory predicts 
that new statements do not appear false, but simply as relatively less true, a 
boundary condition that is established for typical truth paradigms (Hansen 
et al., 2008; see also Wanke & Hansen, 2015). The theory thereby shares 
Gilbert’s (1991) view that people by default believe incoming information 
the same way they believe the existence of physical objects upon seeing 
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them. However, new statements will appear relatively less true than repeated 
statements because they have typically less corresponding references that are 
coherently linked. 

The theory is consistent with philosophical considerations of how peo¬ 
ple judge truth, and it explains the available data on the repetition-induced 
truth effect; statements that have more coherently linked corresponding ref¬ 
erences will also be higher in recognition rates, higher in familiarity, and 
higher in fluent processing. And if one assumes that the links between items 
in memory constitute “knowledge” (e.g., a Sequoia is a tree), the theory 
also explains the interactions of knowledge and repetition when judging 
truth (Fazio, Brashier, Payne, & Marsh, 2015; Unkelbach & Stahl, 2009). 

Finally, the referential theory also explains political and other kinds of 
partisanship or, in other words, why people with agendas and tastes main¬ 
tain beliefs that contradict others’ beliefs. For example, conservatives may 
repeatedly think about, talk with fellow conservatives about, or one-sidedly 
read or hear about positive but not necessarily true aspects of conservative 
politics. This should increase the amount of coherently linked correspond¬ 
ing references activated by statements conveying the same or related posi¬ 
tive aspects (e.g., “Unemployment was at an all-time low during Reagan’s 
presidency”). As a result, statements in favor of conservative, past society 
should become more and more believable, whereas due to an increased 
number of incoherent memory links and decreased processing fluency state¬ 
ments in favor of democratic views should become less believable (vice 
versa for democratic partisans, of course). 

In sum, the referential theory thus suggests a cognitive mechanism of 
how repetition increases information believability and subjective truth. It 
also provides a cognitive explanation why people believe information that 
fits their own agendas and interests, and how these become self-reinforcing 
overtime. The localized nature of these networks also allows for conflict¬ 
ing beliefs within the same person. And most importantly for the present 
purposes, it explains why people may be gullible and believe information 
that they should not believe. Conspiracy theories, urban legends, pseudo 
facts, and “fake” news may become believable not due to motivated rea¬ 
soning, political agendas, or simple stupidity (see Dunning, Chapter 12 this 
volume), but because repetition instigated local networks of coherent refer¬ 
ences that made this information more believable. 

Why Repetition-Induced Truth May Be Functional 

The repetition-induced truth effect exemplifies human gullibility and is also 
a good example how people are blind to the process that generates the data 
on which they base their judgments (see Fiedler, Chapter 7 this volume). 
Again, simply telling people the same thing twice should not make the mes¬ 
sage more believable, especially if the source is identical. But apparently it 
does. However, we want to argue that the repetition-induced truth effect 
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might be functional after all, both from a fluency perspective as well as from 
a referential perspective. 

To argue that such a truth effect might be functional necessitates a defi¬ 
nition of what is functional, rational, or adaptive. This is not as trivial as 
it seems (see Reber & Unkelbach, 2010, for a more detailed treaty). For 
example, James (1909/1975) argued that a belief is justified if the belief 
increases utility for the believer. However, such a utilitarian notion of belief 
justification does not necessarily align with the factual state of affairs or what 
is commonly seen as “truth.” For example, people with a family history 
of cardiovascular diseases might worry about their blood pressure, thereby 
increasing their blood pressure and increase the chance of cardiovascular 
malfunctions. Believing the factually false information that they have no 
such family history may actually have beneficial effects for their blood pres¬ 
sure and thus be functional from a utilitarian perspective (see Kirkham, 
1992, for other justifications of belief). 

Here, we do not follow such a utilitarian approach to belief justifica¬ 
tion, but follow a naive empirical or rational approach. First, one needs to 
assume that there exists a true empirical state of affairs. Second, beliefs that 
correspond more with these true states are to be preferred over beliefs 
that correspond less with these true states. That is, the belief that “the earth 
is round” is preferable over the belief that “the earth is flat.” Although the 
former is not a perfectly true description of the oblate spheroid form of 
the earth, it corresponds more with the empirically accessible facts about 
the earth’s shape. Third, an effect, such as the repetition-induced truth 
effect, is functional if the existence of the effect leads on average to more 
beliefs that correspond with the assumed true state of affairs than when 
the effect would be non-existent. Put more simply, does the repetition- 
induced truth effect lead to more “true” beliefs or to more “false” beliefs? 
In the following, we address such a functionality both from a fluency 
perspective and the referential perspective. 


Functionality from a Fluency Perspective 

Unkelbach (2007) explicitly assumed that people use processing fluency 
in truth judgments because there is a correlation between factual truth 
and processing fluency. In other words, there should be a positive eco¬ 
logical correlation between people’s fluency experiences and truth (see also 
Hertwig, Herzog, Schooler, & Refiner, 2008; Herzog & Hertwig, 2013). 
This positive correlation may exist for a normative as well as a practical 
reason. First, normatively, Grice (1975) proposed the maxims of quality and 
manner in interpersonal communications. That is, people following theses 
maxims should communicate truthfully (quality) and in a fluent, compre¬ 
hensible way (manner). As people follow these two maxims differentially 
(e.g., people in a negative mood follow Grice’s maxims more than people 
in a positive mood; Koch, Forgas, & Matovic, 2013; Forgas, Chapter 10 this 
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volume), message receivers should observe a positive correlation between 
truth and processing fluency. 

Practically, most people should communicate truthfully most of the 
time, as it is hard to imagine a functional society in which false information 
is more frequent than true information. Thus, true information should be 
more frequent compared to false information in the world. Higher fre¬ 
quency entails statistically a higher chance of redundancy and repetition (see 
also Alves, Koch, & Unkelbach, 2017; Koch, Alves, Kruger, & Unkelbach, 
2016), also contributing to a correlation between truth and processing flu¬ 
ency. In addition, physical reality constrains truth such that there is only one 
way for information to be true, but many ways to be false. For example, 
one may state that the earth’s shape is a plane, a cube, or sphere, but only 
one can be true. Similarly, the world’s highest tree might be a spruce, a 
sequoia, or a Eucalyptus tree, but only one can be true. Thus, due to the 
high variety of potentially false information, true information is more likely 
to be repeated (leaving aside strategic miscommunication or false facts/fake 
news that are often repeated, see below). 

One might reformulate this assumed positive correlation into the assump¬ 
tion that the conditional probability of truth given a fluently processed state¬ 
ment (or any information) is larger than 50% (see Rebel' & Unkelbach, 
2010, for a full treaty). Given our definition above (i.e., beliefs are the more 
justified the more they correspond to truth), the repetition-induced truth 
effect is thus functional as long as p(true | fluent) > .50; that is, it is functional 
to believe fluently processed information as long as the probability that this 
fluently processed information is true is larger than 50%. Given the practical 
as well as the normative considerations outlined above, this relation is very 
likely to hold. 


Functionality from a Referential Perspective 

Again, from a fluency perspective, one might state that the effect is func¬ 
tional as long as fluency is an ecologically valid cue (see also Unkelbach 
& Greifeneder, 2013). The p(true | fluent) > .50 assumption, may remain 
untestable empirically, however. A similar empirical problem arises from 
the referential perspective, although one can also make a logical argument 
from this side with a simple thought experiment. 

The sole necessary assumption to argue for the functionality of repetition- 
induced truth from a referential perspective is that experiences with regards 
to the physical world are consistent. If one imagines an environment in 
which information is only available from direct experiences and observa¬ 
tions (e.g., immediately experiencing or observing information), but not 
from indirect or symbolic experiences or observations (e.g., language or 
pictures). Now imagine that someone in this environment directly observes 
that Person A gets sick after consuming Plant X. From a referential perspec¬ 
tive, this should establish the according links between the corresponding 
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references “Person A,” “Plant X,” and “sick.” Now the observer sees that 
Person B, C, and D also get sick after eating Plant X. The resulting network 
of the established links will highlight “Plant X” and “sick,” as these are the 
corresponding references in memory that are common to all the observa¬ 
tions. Thus, there should be a strong association between “Plant X” and 
“sick,” which might lead to an evaluation of the proposition that “Plant X 
is poisonous” as true. 

However, if the observer has already seen many other people consum¬ 
ing Plant X and not getting sick, the proposition that Plant X is poisonous 
will be judged as false. Or, if the observer has consumed Plant B himself/ 
herself and does not get sick, this would provide a strong incoherent corre¬ 
sponding reference (Kunda & Thaggard, 1996). As long as the informational 
input is based on direct observations and experiences, the referential net¬ 
work of corresponding references and their (in)coherence will approximate 
the “true” state of the world and the corresponding beliefs. In other words, 
assuming that there is a true state of the world, the present assumptions will 
lead to beliefs about the world that are approximately correct. The truth 
effect might thus be rooted in a direct, experience-based learning system 
that effectively approximates the truth about the world. And the same way 
the visual system is calibrated by haptic experiences (i.e., learning that the 
world is not upside down), people might learn that beliefs are true if they 
have a higher number of coherent compared to incoherent corresponding 
references in memory and can thus be processed fluently. Thus, the effect 
would be functional according to our definition (i.e., beliefs should approx¬ 
imate truth) as long as it is based on direct experiences and observations. 

Detrimental Effects of Repetition-Induced Truth 

The two caveats for the argument that repletion-induced truth might be 
functional are immediately apparent. From a fluency perspective, one might 
argue that in times of effortless automated online communication, false infor¬ 
mation is as likely to occur as true information. If Grice’s (1975) quality but 
not manner maxim is strategically violated, and if the false information is stra¬ 
tegically repeated, fluency might signal falsehood and the repetition-induced 
truth effect would no longer be functional. Such cases occur typically under 
what is labeled “propaganda,” but might be generalized to any strategic com¬ 
munication attempt. Interestingly, Le Bon (1895/1996) already listed repeti¬ 
tion in his chapter on how leaders might control the masses. 

Second, from a referential perspective, truth by repetition may no longer 
functional if memory is no longer based on direct observations and experi¬ 
ences, but on symbolic experiences mediated by language because some 
information is more likely to be communicated than other information. 
For example, our observer of persons eating Plant X might not see him¬ 
self/herself cases Person A—D but read about them in the newspaper, hear 
about them in the radio, or find out about them on the Internet. Why 


56 Christian Unkeibach and Aiex Koch 

such symbolic experiences may reduce the functionality of inferring truth 
from coherence and fluency by repetition is immediately apparent: in an 
environment of direct observations, all persons eating the plant have an 
approximately equal chance to be observed. As a result, if the factual prob¬ 
ability of getting sick after eating Plant X is low, one will observe few cases 
of sickness after consuming the plant but many cases of Plant X consump¬ 
tions followed well-being. This will prevent the erroneous belief that Plant 
X is poisonous. In an environment of symbolic communication (i.e., social 
media, television) that prioritizes novel and exceptional news over repre¬ 
sentatively sampled news (see Fiedler, Chapter 7 this volume), all the con¬ 
sumption cases without sickness will be most likely not reported, preventing 
the corresponding references to be established and incoherently linked to 
“Plant X” and “sick.” Rather, by all likelihood, the few sickness cases will 
get reported, and most likely repeatedly, increasing the probability that a 
proposition such as “Plant X causes sickness” will have many coherent cor¬ 
responding references and thus will become an established belief. 

The example parallels some of the most unfortunate false beliefs (here, 
we use “false” as improbable by any scientific standard; e.g., “Vaccinations 
cause autism”). All vaccinated children that never showed any signs of 
autism will not be symbolically represented (i.e., appear in the media); if 
anything, they may enter a medical summary statistic. Thus, a single case of 
autism though for a child who received a vaccination, without any causal¬ 
ity implied, to be clear, that will get symbolic representation has almost the 
same impact and value as the summary statistic of all the cases where no 
evidence for autism after vaccinations was found (i.e., it may be represented 
as a single corresponding reference). In short, a pediatrician forming beliefs 
based on experience may not come to the belief that vaccinations cause 
autism. The layperson surfing the internet on the other hand may very 
well develop this belief, simply because it is repeated so frequently. Thus, 
although the referential perspective implies that the repetition-induced 
truth effect is functional if based on direct experiences and observations, 
it also provides a model for how symbolic communication may lead to the 
formation of false beliefs. 

Is Repetition-Induced Truth Avoidable? 

Assuming that repetition-induced truth is a form of gullibility, a final ques¬ 
tion is how one may avoid or ameliorate this form of gullibility. The pre¬ 
sent volume suggests some ways in which repetition-induced truth may be 
avoided. For example, a mindset of distrust (Mayo, Chapter 8 this volume) 
may lead people to consider the opposite and therefore lead to less impact 
of information repetition. Similarly, negative mood (Forgas, Chapter 10 
this volume) might inoculate people against the influence of information 
repetition. Or most generally, any cue that might trigger more skepticism 
for internal signals such as bad smells (Schwarz & Lee, Chapter 13 this 
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volume) or cultural disfluency (Oyserman, Chapter 14 this volume) may 
reduce repetition-induced truth. However, to the best of our knowledge, 
the attempts in the literature to curb the effects of repetition on judged truth 
were remarkably unsuccessful. For example, Fazio and colleagues (2015) 
selected statements for their truth effect paradigms for which participants 
should have knowledge. Nevertheless, the influence of repetition did not 
differ between such “possible-to-know” statements and “impossible-to- 
know” statements. Similarly, Unkelbach and Greifeneder (2018) found that 
when participants are given external advice whether a statement is true or 
not, the repetition influence remains stable, even when this advice is sup¬ 
posedly 100% valid. Thus, although the present volume suggests some paths 
to cure this form of gullibility, the empirical evidence so far suggests that the 
influence of repetition on judged truth will prevail. 

Conclusion 

The repetition-induced truth effect is a prime example of human gullibil¬ 
ity. Whether it turns lies into truths, fiction to fact, or advertisements into 
successful persuasion, it is a seemingly easy-to-exploit effect. Based on the 
two explanations for the effect, the fluency explanation and the referential 
explanation, however, we argue that the effect is functional when infor¬ 
mation comes from direct experiences and observations. In an environ¬ 
ment of direct experiences and observations, easily processed information 
is more likely true than false, and because nature does not contradict itself, 
networks of coherent references lead to the formation of correct beliefs. 
Thus, inferring truth from repetition may be an easy and useful shortcut 
to adequate truth judgment. However, in an environment of indirect and 
symbolic observations, repetition-induced truth may lead to the formation 
of incorrect beliefs. To the best of our knowledge, though, the belief that 
the highest tree in the world is a Sequoia tree in California, is correct. 

Note 

1 Please note that the character in whose train of thoughts this statement occurs, 
Bernard Marx, factually does not endorse this practice and reflects on the senti¬ 
ment with the internal exclamation:“Idiots!” 
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Conspiracy theories attribute significant social and political events to 
the actions of controlling and malevolent groups (e.g., Goertzel, 1994; 
Uscinski & Parent, 2014). For example, well known conspiracy theo¬ 
ries suggest that the 9/11 attacks on the Twin Towers were an “inside 
job” orchestrated by the Bush administration to justify the war on terror, 
and that Diana, Princess of Wales was assassinated by the British Secret 
Service because she was a nuisance to the British establishment. Belief in 
conspiracy theories is more common than you might think. For example, 
over half of Americans believe that Lee Flarvey Oswald did not act alone 
in the assassination of President John F. Kennedy (Jensen, 2013; Swift, 
2013). Furthermore, recent polls suggest that nearly half of British peo¬ 
ple believe that the government is hiding information about the number 
of immigrants in the UK (Moore, 2016). There is therefore no doubt 
that conspiracy theories are popular. But are conspiracy believers gul¬ 
lible? Will they believe anything they hear? In this chapter, we argue that 
the research evidence to date does not support this conclusion. Instead, 
conspiracy theories seem to appeal to people when they need to satisfy 
important psychological motives. 

Specifically, Douglas, Sutton, and Cichocka (2017) argued that people 
are drawn to conspiracy theories when - compared with nonconspiracy 
explanations - they seem to satisfy important social psychological motives 
that can be characterized as epistemic (e.g., the desire for understanding, 
accuracy, and subjective certainty), existential (e.g., the desire for control 
and security), and social (e.g., the desire to maintain a positive image of 
the self or group). We outline each of these motives in turn, highlighting 
evidence that people are drawn to conspiracy theories for these reasons in 
particular, and not because they will simply believe anything they hear. We 
also consider whether such psychological motives are met by believing in 
conspiracy theories. Finally, we take a broader perspective on how future 
research might expand this taxonomy, and directions that research on the 
psychology of conspiracy theories might take in future to further test the 
reasons why people believe in conspiracy theories. 
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Epistemic Motives 

Heider (1958) argued that finding causal explanations for events is an 
important part of creating a consistent and accurate understanding of the 
world. People want to know the truth and be certain of that truth. They 
are also curious and want to find out new information. Furthermore, 
people are generally intolerant of uncertainty and want to find meaning 
even when events may seem random or very unlikely (Dugas, Gosselin, 
& Ladouceur, 2001). As causal explanations for events, conspiracy theo¬ 
ries might appear to satisfy these motives. Specifically, they seem to pro¬ 
vide broad, internally consistent explanations that allow people to maintain 
beliefs in situations of uncertainty and contradiction. They are often resist¬ 
ant to falsification by proposing that multiple actors coordinate and cover 
up their actions, and by implication that people who try to debunk them 
are part of the conspiracy (Lewandowsky et al., 2015). Conspiracy theories 
can also allow people to maintain consistency in their own beliefs (e.g., that 
climate change is not a serious issue) by characterizing evidence (e.g., sci¬ 
entific findings) as conspiracies themselves (Grimes, 2016; Lewandowsky, 
Oberauer, & Gignac, 2013). 

Research supports this view that people turn to conspiracy theories for 
epistemic reasons. First, research consistently links conspiracy beliefs with 
uncertainty. Van Prooijen andjostmann (2013) hypothesized that uncer¬ 
tainty should increase the extent to which people interpret signs suggesting 
that authorities are moral (or immoral) as evidence of conspiracy. In one 
of their experiments, the researchers manipulated uncertainty salience by 
asking people to think about the emotions they experience during times 
of uncertainty, or when they are watching television (control). Following 
the manipulation, they were presented with information about the moral¬ 
ity or immorality of oil companies, before completing conspiracy-related 
questions about oil companies’ involvement in the Iraq war. Van Prooijen 
andjostmann (2013) found that people were only influenced by the moral¬ 
ity information (i.e., conspiracy beliefs were heightened) when they were 
uncertain. Uncertainty seemed to be a pre-requisite forjudging the plau¬ 
sibility of conspiracy theories even when information about morality was 
also prominent. 

Research also links conspiracy beliefs with a search for patterns and 
meaning. For example, a study by Whitson and Galinsky (2008) found that 
the extent to which people saw patterns in noise was associated with belief 
in conspiracy theories. This suggests that belief in conspiracy theories is 
stronger among people are looking for patterns. A recent set of studies by 
van Prooijen, Douglas, and de Inocencio (2018) also showed that con¬ 
spiracy beliefs are associated with pattern perception, but specifically, when 
patterns are illusory — that is there are no patterns and stimuli are completely 
random. In one of their studies, van Prooijen et al. (2018) asked participants 
to view sequences of random coin tosses (generated from a website called 
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“random.org”), and to rate the extent to which the sequences were com¬ 
pletely random, or completely determined. Participants were also asked to 
rate the extent to which they believed in well-known and fictitious con¬ 
spiracy theories, as well as supernatural phenomena. Results revealed robust 
relationships between all variables, but most important for the current dis¬ 
cussion that belief in both well-known and fictitious conspiracy theories 
were associated with illusory pattern perception. 

Belief in conspiracy theories therefore appears to be a very basic cogni¬ 
tive response to the search for patterns where they do not, or are unlikely to, 
exist (but see Dieguez, Wagner-Egger, & Gauvrit, 2015 for evidence that 
this might not always occur). Furthermore, one recent set of studies dem¬ 
onstrated that belief in conspiracy theories is driven by a readiness to draw 
implausible causal connections even when stimuli are not random and do 
show a pattern (e.g., the case of real-life spurious correlations; van der Wal, 
Sutton, Lange, & Braga, 2018). Other research shows that conspiracy beliefs 
are stronger among people who seek other types of patterns in the environ¬ 
ment, such as religious believers and believers in paranormal and supernatu¬ 
ral phenomena (e.g., Bruder, Haffke, Neave, Nouripanah, & Imhoff, 2013; 
Darwin, Neave, & Holmes, 2011; Drinkwater, Dagnall, & Parker, 2012; 
Leiser, Duani, & Wagner-Egger, 2017; Oliver & Wood, 2014). Research 
also suggests that people are more likely to adopt conspiracy theories for 
events that are especially important or large scale. It is argued that the pro¬ 
portionality bias - that causes must be proportional to effects - means that 
small, mundane explanations for important events (e.g., that Princess Diana 
died because the driver of the car was drunk) are not as satisfying as larger 
and more elaborate explanations (e.g., that she was murdered by the British 
government; Leman & Cinnirella, 2007). 

Beliefs in conspiracy theories have also been linked to the need for cog¬ 
nitive closure, which is the tendency to form quick judgments on any given 
topic (Kruglanski, 1990). Marchlewska, Cichocka, and Kossowska (2017) 
asked participants to complete a scale measuring the need for cognitive clo¬ 
sure, and then some text relating the European Union’s plans to finance 
refugees’ stay in Poland. For some participants, this text introduced the idea 
of conspiracy by mentioning an alleged Internet conversation stating that 
the European Union’s support for refugees in Poland was an attempt to gain 
control over Poland (vs. a control condition with irrelevant information). 
Participants were then asked to indicate their support for the conspiracy 
theory. Results revealed that the need for cognitive closure was associated 
with belief in the conspiracy theory, but that it was stronger when the 
conspiracy explanation was made salient. That is, people high in need for 
cognitive closure were more likely to believe the straightforward conspiracy 
explanation when it was available to them. Another experiment showed 
that this effect was especially important when events lacked a clear, official 
explanation (see also Leman & Cinnirella, 2013 for evidence of the link 
between need for cognitive closure and belief in conspiracy theories). 
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Evidence suggests that people might also turn to conspiracy theories 
as a result of cognitive errors or biases. For example, conspiracy beliefs 
have been linked to the conjunction fallacy (Brotherton & French, 2015; 
Dagnall, Denovon, Drinkwater, Parker, & Clough, 2017), which is an 
error of probabilistic reasoning in which people overestimate the likeli¬ 
hood of co-occurring events (Tversky & Kahneman, 1983). In two studies, 
Brotherton and French (2014) first examined people’s tendency to com¬ 
mit conjunction errors. For example, in one scenario, participants were 
told that a group of students were visiting a beer garden after university 
and were asked to estimate the probability that (1) it is a warm summer’s 
day, (2) that there are people sitting in the beer garden, and that (3) it is 
a warm summer’s day and there are people sitting in the beer garden. A 
conjunction error occurs when participants rate the probability of (3) as 
being higher than one or both of (1) and (2). Brotherton and French found 
that the tendency to commit conjunction errors was significantly related to 
conspiracy beliefs. This occurred when the conjunctions were neutral, or 
had a conspiracy flavor. 

Others have shown that projection of one’s own personal beliefs onto 
others is associated with conspiracy beliefs. Douglas and Sutton (2011) 
found that people’s tendency to believe in conspiracy theories is associated 
with the tendency to believe that — in the same situation — they would 
participate in the conspiracy themselves. That is, the belief that “they con¬ 
spire” is in part the result of the belief that “I would conspire.” Further, 
Douglas, Sutton, Callan, Dawtry, and Harvey (2016) found that hypersensi¬ 
tive agency detection - the tendency to attribute agency and intentionality 
where it does not (or is unlikely to) exist - was associated with conspiracy 
beliefs (see also Brotherton & French, 2014; van der Tempel & Alcock, 
2015). Finally, McHoskey (1995) found that conspiracy beliefs may be in 
part a product of biased assimilation — carefully and critically analyzing infor¬ 
mation that disconfirms one’s views but uncritically accepting information 
that confirms them (see also Thorson, 2015). 

Various cognitive limitations have also been associated with conspiracy 
belief. For example, Swami, Voracek, Stieger, Tran, and Fumham (2014) 
found that lower levels of analytic thinking predicted conspiracy beliefs. 
In further experiments, Swami et al. (2014) asked participants to complete 
a range of tasks designed to elicit analytic thinking (e.g., verbal fluency, 
cognitive disfluency) and found that engaging in these tasks reduced belief 
in conspiracy theories. Conspiracy believers also tend to score lower in 
rational thinking style (Mikuskova, 2018) and higher in intuitive thinking 
(Swami et al., 2014). Furthermore, people appear to look to conspiracy 
theories when they are bored (Brotheton & Eser, 2015), when they have 
lower levels of intelligence (Stieger, Gumhalter, Tran, Voracek, & Swami, 
2013), and when they are less educated (Douglas et al., 2016). Perhaps 
conspiracy theories are adopted when knowledge - but also the ability to 
acquire knowledge - is lacking. 
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Other cognitive processes associated with belief in conspiracy theo¬ 
ries involve a tendency to accept epistemically unjustified beliefs (Lobato, 
Mendoza, Sims, & Chin, 2014), and a general tendency toward religious or 
quasi-religious thinking (Franks, Bangerter, Bauer, Hall, & Noort, 2017). 
Finally, conspiracy beliefs tend to be positively correlated with factors such 
as non- or sub-clinical delusional thinking (Dagnall et al., 2017) and schizo- 
typy, which describes a range of personality characteristics and experiences 
from normal to psychotic (Barron, Morgan, Towell, Altemeyer, & Swami, 
2014; Bruder et al., 2013; Darwin et al., 2011; Swami, Pietschnig et al., 
2013; van der Tempel & Alcock, 2015). 

Overall, therefore, there is evidence that conspiracy theories appeal to 
individuals who seek accuracy and meaning (or both) but perhaps lack the 
cognitive tools or experience difficulties that prevent them from finding 
these via other means. Conspiracy theories therefore appeal to people who 
are looking for the truth but seem to lack the skills to look in the right 
places. This coheres with research showing that the most “unskilled” people 
are also the most prone to errors and misinformation, and at the same time 
they are the most “unaware” of the errors and misjudgments they are mak¬ 
ing (see Dunning, Chapter 12 this volume). 

At this point, many readers would quite naturally draw the conclusion 
that conspiracy believers must therefore be gullible. They are cognitively 
limited, uneducated, prone to cognitive errors and biases, and they do not 
think analytically. They make irrational choices when evaluating differ¬ 
ent pieces of information (see also van Prooijen, Chapter 17 this volume). 
They must therefore believe anything they hear without critical evaluation. 
However, we feel that this conclusion would be premature. People will 
not believe anything they hear. Instead, they appear more likely to turn 
to conspiracy theories that could help them plug gaps in missing informa¬ 
tion, rather than believing anything at all. That is, they are seeking specific 
knowledge and not just anything will do. Furthermore, conspiracy believers 
often characterize themselves as truth seekers, defenders of the truth, and 
“skeptics.” That is, they are skeptical of the information they receive from 
officialdom and are explicitly looking for facts and answers to critical ques¬ 
tions. They are not blindly accepting what anyone will tell them — quite the 
opposite. They are perhaps just looking in the wrong places for these facts 
and answers. Also, cognitive factors are only one part of the picture that 
explain why people believe in conspiracy theories. There are other impor¬ 
tant motives that need to be considered (existential and social) as we explain 
in the remainder of this chapter. 

Existential Motives 

In addition to their epistemic purposes, causal explanations for events help 
people to feel safe and secure and also to be able to control things that hap¬ 
pen to them and to their social groups (Tetlock, 2002). Early perspectives 
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on conspiracy beliefs suggested that people turn to conspiracy theories for 
compensatory satisfaction when they do not feel safe and do not feel that 
they have control. For example, conspiracy theories may promise to make 
people feel safer because dangerous and deceitful individuals are identified 
and the threat they pose is countered (Bost & Prunier, 2013). Also, people 
who feel that they lack control may feel better when they adopt conspiracy 
theories because such theories allow them to feel that they possess an alter¬ 
native, and non-official account (Goertzel, 1994). 

Research supports the idea that people turn to conspiracy theories in 
a bid to fulfill existential motives. For example, studies have shown that 
people are likely to turn to conspiracy theories when they are anxious. 
Grzesiak-Feldman (2013) asked university students to complete a state-trait 
anxiety measure and found that both were associated with belief in conspir¬ 
acy theories about Jewish people, Germans, and Arabs. In two further stud¬ 
ies, Grzesiak-Feldman also showed that anxiety-inducing situations (i.e., 
waiting for exams) were associated with increased belief in conspiracy theo¬ 
ries. People who feel powerless are also more likely to believe conspiracy 
theories (Abalakina-Paap, Stephan, Craig, & Gregory, 1999). People who 
have an insecure attachment style are also more likely to believe in conspir¬ 
acy theories (Green & Douglas, 2018). Conspiracy beliefs are also strongly 
related to lack of sociopolitical control or lack of psychological empower¬ 
ment (Bruder et al., 2013; see also Nyhan, 2017; Uscinski & Parent, 2014). 
Also, experiments have shown that conspiracy beliefs are greater when peo¬ 
ple feel unable to control outcomes, but that it is reduced when their sense 
of control is affirmed (van Prooijen & Acker, 2015). 

Belief in conspiracy theories is also correlated with existential anxiety 
(Newheiser, Farias, & Tausch, 2011), and anomie - a feeling of personal 
unrest and lack of understanding of the social world (e.g., Abalakina-Paap 
et al., 1999; Bruder et al., 2013; Goertzel, 1994). Belief in conspiracy theo¬ 
ries is also associated with a belief that the economy is getting worse (Parsons, 
Simmons, Shinhoster, & Kilbum, 1999). People may therefore feel that 
conspiracy theories will help them come to terms with their particular prob¬ 
lems, enabling them to regain some of the psychological goods that they 
have lost (Franks et al., 2017). Specifically, Franks et al. (2017) argue that 
conspiracy theories help people make sense of unsettling events and provide 
optimism that things will change. In a similar vein, other researchers have 
demonstrated that conspiracy theories might buffer people from threats to 
the social system in which they live, such as a suffering economy, or nega¬ 
tive social and political events (Jolley, Douglas, & Sutton, 2018). 

There is therefore a convincing amount of evidence that people turn to 
conspiracy theories in an attempt to satisfy existential motives. This, how¬ 
ever, does not mean that they are gullible. Believing in conspiracy theories 
to fulfill existential motives does not mean that people will believe simply 
anything they hear. Instead, the conspiracy beliefs are determined by the 
nature of the existential needs. For example, if people are feeling unsettled 
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about a particular issue, they might gravitate toward conspiracy theories to 
resolve the issue but they would not feel compelled to adopt conspiracy the¬ 
ories that are unrelated to that need. Using conspiracy theories to rationalize 
feelings of powerlessness is also not necessarily a gullible response. People 
will not simply believe anything — they will believe what helps them come 
to terms with the psychological goods that they are missing. 

Social Motives 

Causal explanations are also informed by a variety of social motivations, 
including the need to belong and to maintain a positive image of the self 
and the social groups that people belong to. Conspiracy theories may also 
be adopted in an effort to fulfill such social motives. For example, scholars 
have suggested that conspiracy theories may boost people’s image of the self 
and the in-group by allowing blame for negative outcomes to be attributed 
to others. Thus, conspiracy theories may help to uphold people’s image of 
the self and their in-group as capable and honest but as harmed or impaired 
by powerful and immoral others. 

Research to date supports this argument. For example, Cichocka, 
Marchlewska, and Golec de Zavala (2016) found that conspiracy theories 
were particularly appealing to narcissists, who have an inflated yet insecure 
feeling of self-worth. Other studies have shown links between conspiracy 
beliefs and the social psychological need to feel unique to others (Imhoff & 
Lamberty, 2017; Lantian, Muller, Nurra, & Douglas, 2017). For example, 
in one experiment, Lantian et al. (2017) manipulated the need for unique¬ 
ness by asking participants to complete a task in which they were asked 
to think and write about the importance of individuality (vs. conformity), 
which is designed to increase (vs. decrease) the need to feel unique. Results 
revealed that participants in the individuality condition were more likely to 
believe conspiracy theories about a fictitious event than those in the con¬ 
formity condition. It is argued that conspiracy theories allow people to feel 
that they are in possession of rare, important information that other people 
do not have, making them feel special and thus boosting their self-esteem. 

Conspiracy theories are also important to the need to feel good about our 
social groups. Researchers have further found that conspiracy theories — in 
addition to appealing to individual narcissists - are also particularly appeal¬ 
ing to collective narcissists who believe in the in-group’s greatness paired with 
a belief that other people do not appreciate it enough. That is, the more 
narcissistic people are about their groups, the more they are likely to believe 
that other groups are conspiring against them. Specifically, Golec de Zavala 
and Cichocka (2012) found that national collective narcissism in Poland 
predicted endorsement of conspiracy stereotypes of Jews. Also, Cichocka, 
Marchlewska, Golec de Zavala, and Olechowski (2016) demonstrated that 
national collective narcissism in Poland was associated with the endorsement 
of conspiracy theories about Russian involvement in the Smolensk crash of 
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2010 in which the Polish president and several officials died. However, 
ordinary identification with the national group without narcissism predicted 
lower likelihood of endorsing these conspiracy theories. This suggests that 
conspiracy explanations of intergroup events derive from a need to validate 
the group image by disparaging out-groups. 

Other social motives appear relevant to conspiracy theories, including 
the need to belong. Graeupner and Coman (2017) considered the relation¬ 
ship between social exclusion and belief in conspiracy theories. Participants 
in one study were asked to think about a social interaction and rate how 
socially excluded they felt after the event. They were then asked to rate 
their agreement with a set of well-known conspiracy theories. Results 
revealed a relationship between social exclusion and belief in conspiracy 
theories, and a second (experimental) study showed that social exclusion 
also influenced superstitious beliefs. Graeupner and Coman argued that 
people turn to these beliefs to try to make sense of their negative social 
experiences. Furthermore, members of groups who have objectively low 
(vs. high) status because of their ethnicity (Crocker, Luhtanen, Broadnax, 
& Blaine, 1999) or income (Uscinski & Parent, 2014) appear more likely to 
believe in conspiracy theories. For example, Crocker et al. (1999) demon¬ 
strated that Black Americans (compared to White Americans) were more 
likely to believe in conspiracy theories about the American government 
conspiring against Blacks. Feeling socially disadvantaged and disenfran¬ 
chised therefore appears to be a significant determinant of whether or not 
conspiracy theories appeal to people. 

Related to this point, research from political science suggests that people 
on the losing (vs. winning) side of political processes are also more likely to 
believe conspiracy theories. Specifically, Uscinski and Parent (2014) argue - 
based on analyses of archival data from over 100 years of newspaper let¬ 
ters and also representative surveys - that people use conspiracy theories 
when they are powerless to defend themselves against the powerful. In 
other words, conspiracy theories are for “losers.” Along this vein, con¬ 
spiracy beliefs have also been linked to prejudice against powerful groups 
(Imhoff & Bruder, 2014) and groups that are viewed as enemies (Kofta & 
S^dek, 2005). Groups who feel that they have been victimized are also more 
likely to endorse conspiracy theories about other more powerful groups 
(Bilewicz, Winiewski, Kofta, & Wojcik, 2013; Mashuri & Zaduqisti, 2014). 

Given such experiences, it is not gullible for people to believe that dom¬ 
inant groups have been (and probably still are) conspiring against them. 
When people believe in conspiracy theories, they are often responding 
to real threats, inequalities, and historical instances of threat and victimi¬ 
zation. People therefore adopt beliefs that protect their own groups. To 
give another example, when left-wingers believe conspiracy theories that 
demonize right-wingers (and vice versa), they are endorsing beliefs that 
cohere with their political views, and indeed there is evidence that people 
do so at both ends of the political spectrum (Uscinski & Parent, 2014). If 
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people were simply being gullible, they would believe in all conspiracy 
theories, but it is clear that they do not. Belief in conspiracy theories is 
motivated by people’s group memberships and the beliefs that are associated 
with those group memberships. 

In further support of this point, studies have shown that people are more 
likely to believe in conspiracies directed at their own group if they have per¬ 
sonally experienced discrimination, such as being the victim of police har¬ 
assment (Parsons et al., 1999), or race discrimination (Simmons & Parsons, 
2005). Situational threats and crisis situations can also increase the likelihood 
of conspiracy beliefs (Kofta, S^dek, & Slawuta, 2011; Mashuri & Zaduqisti, 
2014; van Prooijen & Douglas, 2017). It is therefore important to consider 
the political, social, and historical contexts that make conspiracy theories 
seem more believable to people than conventional explanations (see also 
Nattrass, 2013). People do not simply believe anything - they believe what 
they want to believe. 

How Well Do Conspiracy Theories Satisfy 
Psychological Motives? 

Relatively little research has addressed this question to date. However, the 
existing research suggests that conspiracy theories may be more appeal¬ 
ing to people than actually satisfying their psychological motives. Taking 
existential motives first, some research suggests that rather than reducing 
uncertainty, conspiracy theories might even increase it. Specifically, Jolley 
and Douglas (2014a) asked people to read conspiracy theories about gov¬ 
ernments in one study, and about climate change in another. In each case, 
participants were asked how uncertain they felt and their responses were 
compared with participants who had either been in a control condition with 
no information, or an anti-conspiracy condition with material refuting the 
conspiracy theories. In each case, conspiracy theories — rather than making 
people feel more certain — made people feel even more uncertain. 

There also seems to be little evidence that conspiracy theories satisfy exis¬ 
tential motives. On the contrary, experimental exposure to conspiracy theo¬ 
ries appears to immediately suppress people’s sense of autonomy and control 
(Jolley & Douglas, 2014a, 2014b). For example, in the study mentioned in 
the previous paragraph by Jolley and Douglas (2014a), the researchers also 
measured feelings of powerlessness. These feelings increased - rather than 
decreased - as a result of being exposed to conspiracy theories. These same 
studies have also shown that conspiracy theories make people less inclined to 
take actions that, in the long term, might boost their autonomy and control. 
Specifically, after exposure to conspiracy theories, people are less inclined 
to commit to their workplaces (Douglas & Leite, 2017) and to engage in 
mainstream political processes such as voting and party politics (Jolley & 
Douglas, 2014a). Exposure to conspiracy theories may undermine people’s 
control and power in another, more subtle way. Douglas and Sutton (2008) 
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showed that people were effectively persuaded by conspiracy theories about 
the death of Princess Diana but were not aware that they had been per¬ 
suaded. Instead, they falsely recalled that their previous beliefs were identical 
to their new beliefs. Being influenced without awareness is arguably not an 
empowering position. 

Furthermore, although people are clearly drawn toward conspiracy theo¬ 
ries in an attempt to satisfy their social motivations, it is not clear that this is a 
strategy that works. A typical feature of conspiracy theories is their negative, 
distrustful representation of others and out-groups. Thus, it is reasonable to 
suggest that they are not only an indication but also a cause of the feelings 
of alienation, disenfranchisement, and anomie with which they are associ¬ 
ated (e.g., Abalakina-Paap et al., 1999). Experiments have also shown that 
exposure to conspiracy theories decreases trust in governmental institutions, 
even if the conspiracy theories are completely unrelated to those institu¬ 
tions (Einstein & Glick, 2015). It also causes people to trust politicians and 
scientists less, and to disengage with politics and scientific findings (Jolley & 
Douglas, 2014a). So far, research therefore suggests that conspiracy theories 
may further frustrate rather than satisfy people’s social motives. 

Summary and Future Directions 

This does not mean that conspiracy believers are gullible, however. It does 
mean that the psychological crutch that people are using may not support 
them in the way they might hope. Beliefs in conspiracy theories may be 
ultimately self-defeating, but not straightforwardly a reflection of gullibility. 
We expect that further research will be undertaken to test the framework of 
Douglas et al. (2017) and to examine when conspiracy theories might satisfy 
people’s psychological motives and when they might not. 

Indeed, there are grounds to expect future research to show that conspir¬ 
acy theories fulfill the motives of some people but not others. The experi¬ 
mental research conducted thus far has only sampled from populations such 
as undergraduate students and survey panelists who are not gready disadvan¬ 
taged or threatened. Furthermore, these populations tend to show quite low 
levels of conspiracy beliefs. Typically, on a seven-point scale, conspiracy 
beliefs are just above or below the midpoint of the scale (e.g., see Douglas 
& Sutton, 2011). These are people who therefore generally do not endorse 
conspiracy theories. For these people, conspiracy theories are likely to be 
experienced as bothersome or worrying, but not daily concerns that deter¬ 
mine other activities in their lives. 

These are not the people who scholars have in mind when they argue 
that conspiracy theories may sometimes help people satisfy their needs 
and motives. Instead, they are typically referring to groups and individuals 
who are already estranged from society and for whom conspiracy theories 
may offer some compensation for lost psychological goods. These include 
disempowered groups who may use conspiracy theories to destabilize 
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powerful groups and systems by formulating their own understanding of 
realities (Sapountzis & Condor, 2013) and by group cohesion and collec¬ 
tive action (Adams, O’Brien, & Nelson, 2006). In these communities — and 
indeed in prominent online conspiracy communities such as the 9/11 Truth 
movement — conspiracy beliefs may offer an important source of belonging 
and shared reality. 

Furthermore, it is clear that elites do conspire against public interests - 
that is, real conspiracies do happen. Conspiracy theories play an impor¬ 
tant role in making people aware of what has happened, and opening 
important information for discussion and debate. To be sure that con¬ 
spiracy theories are harmful rather than helpful, further research needs 
to be conducted on people who have greater psychological motives to 
fulfill. That is, more detailed and longitudinal studies of disadvantaged 
populations are necessary. 

Future research should also investigate other factors that might influence 
the extent to which people believe in conspiracy theories. For example, 
Forgas (Chapter 10 this volume) has demonstrated that everyday fluctua¬ 
tions in mood can influence people’s levels of trust and acceptance of misin¬ 
formation. No research to date has investigated how mood might influence 
conspiracy beliefs, however. It is plausible based on Forgas’s research that a 
good mood could lead people to be less concerned about the fulfillment of 
social needs (i.e., they already feel good), and therefore make them more 
receptive to conspiracy theories. Future research could also consider the 
influence of the source of the conspiracy theories (see Cooper & Avery, 
Chapter 16 this volume). Taking into account the social motives associ¬ 
ated with conspiracy beliefs, it is reasonable to suggest that people will 
believe conspiracy theories more if uttered by their peers than by outsiders. 
We also know little about the effects of repetition on conspiracy beliefs, 
but repetition of misinformation is likely to influence its acceptance (see 
Myers, Chapter 5 this volume; Unkelbach & Koch, Chapter 3 this volume). 
Finally, there is a limited amount of research on how conspiracy theo¬ 
ries are processed when people come across them, and different levels of 
processing at the point of information encoding can influence information 
acceptance (Mayo, Chapter 8 this volume). In general, we call for a more 
detailed approach to the study of conspiracy theories than much of the cur¬ 
rent research (leading to the gullibility conclusion) has presented. 

Finally, some conspiracy theories may indeed reflect believers’ gullibility. 
Specifically, one cannot equate conspiracy theories about the 9/11 attacks 
or the assassination of President John F. Kennedy with conspiracy theories 
about lizard aliens ruling the world, or those proposing that the earth is flat. 
There are clearly distinctions between conspiracy theories and the peo¬ 
ple who believe them might therefore also differ on important dimensions. 
Although there is evidence that people who believe in one conspiracy the¬ 
ory also tend to believe in others (e.g., Goertzel, 1994; Wood, Douglas, & 
Sutton, 2012), studies have tested belief in well-known conspiracy theories 
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rather than those that could be considered as more far-fetched. People who 
believe in the more far-fetched conspiracy theories may indeed show char¬ 
acteristics of gullibility. To date, there is no reliable typology of conspiracy 
theories but it clear that not all conspiracy theories are equal. 

Closing Remarks 

We have overviewed the recent taxonomy of conspiracy beliefs proposed 
by Douglas et al. (2017) in which it is argued that people are attracted to 
conspiracy theories in an attempt to fulfill epistemic, existential, and social 
motives. In reviewing the evidence for this argument, we also argue that 
conspiracy theories cannot simply be viewed as something that only the 
most gullible people will believe. Our framework supports this argument — 
people will not believe in just anything but they will believe what is likely to 
help them satisfy their motives. We therefore argue that conspiracy theories 
may be better viewed as a psychological prop that people lean on to allevi¬ 
ate specific psychological frustrations. More research is needed to determine 
when this strategy works and when it does not. 
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5 Psychological Science Meets a 
Gullible Post-Truth World 


David G. Myers 

HOPE COLLEGE 


Gullibility poisons and polarizes today’s public life. We live, declared the 2016 
Oxford Dictionary with their word of the year, in a “post-truth” age. The 
Collins Dictionary seemingly concurred, by naming “fake news” — false infor¬ 
mation disseminated under the guise of news — its 2017 word of the year. And 
the Rand Corporation offered a 326-page report on Truth Decay, exploring 
“the diminishing role of facts and analysis” (Kavanagh & Rich, 2018). 

In the United States, concerns for citizen gullibility cross party lines. 
In his farewell address, President Obama (2017) warned that a “threat to 
democracy” was growing from the lack of a “common baseline of facts” 
and from underappreciating “that science and reason matter.” We have 
become, he lamented, “so secure in our bubbles that we start accepting only 
information, whether it’s true or not, that fits our opinions, instead of basing 
our opinions on the evidence that is out there.” His one-time opponent, 
Republican Senator John McCain (2017) expressed comparable alarm about 
“the growing inability, and even unwillingness, to separate truth from lies.” 

Concerns about gullibility and misinformation extend beyond poli¬ 
tics. Is eating genetically modified (GM) foods safe? Yes, say 37% of U.S. 
adults, and 88% of 3,447 American Association for the Advance of Science 
members (Funk & Rainie, 2015). Is climate change “mostly due to human 
activity?” Yes, assume 62% of U.S. adults and nearly all climate science 
articles (Powell, 2015; Saad, 2017). 

“This is not about Republicans versus Democrats,” observed National 
Institutes of Health former director Harold Varmus (2017). "It is about 
a more fundamental divide, between those who believe in evidence . . . 
and those who adhere unflinchingly to dogma.” And that divide is hugely 
important, reflected British historian Simon Schama (2017): “Indifference 
about the distinction between truth and lies is the precondition of fascism.” 

Gullibility and Misinformation Writ Large: 

The U.S. Example 

Steven Pinker (2018) reminds us that human gullibility is long-standing: 
Unlike our medieval ancestors, few folks today “believe in werewolves, 
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unicorns, witches, alchemy, astrology, bloodletting, miasmas, animal sac¬ 
rifice, the divine right of kings, or supernatural omens in rainbows and 
eclipses” (p. 376). Yet gullibility endures. Its enduring extent and impact — 
and the impetus for this symposium — appear in Americans’ striking mis¬ 
perceptions of social reality, with people’s beliefs often divorced from facts. 
“Between the idea/and the reality/ . . . falls the shadow” (T. S. Eliot). Some 
examples: 

Perception: Crime is rising. “The murder rate in our country is the highest 
it’s been in 47 years,” said Donald Trump (2017) shortly after his inau¬ 
guration. Most Americans nod their heads in agreement. Each recent 
year 7 in 10 Americans have told Gallup they believe that the United 
States has suffered more crime than in the previous year (Figure 5.1; 
Swift, 2016). 

Reality: Crime is falling. But FBI violent crime data (aggregated from 
local crime reports) reveals an alternative (actual) reality. Violent crime 
has plummeted (2017; Figure 5.2). This reality of decreasing crime is 
confirmed in people’s self-reports to the Bureau of Justice Statistics 
(2016; Figure 5.3). Property crime rates and reports have similarly 
declined. Ergo, belief and fact have traveled in opposite directions. And 
when fear and fact conflict, fearmongering often wins. 

Perception: Many immigrants are criminals. “On the issue of crime,” a 
Gallup survey (McCarthy, 2017) reveals, “Americans are five times 
more likely to say immigrants make the situation worse rather than 


Americans’ Perceptions of Crime, 1989-2016 

Is there more crime in the United States than there was a year ago, or less? 



!_I % More H % Less 


Figure 5.1 The perception: Americans perceive that crime is rising. 

Source: Adapted from Gallup polls, https://news.gallup.com/poll/197318/americans-perceptions- 
crime-problem-steady.aspx. 






Reported Violent Crime Rate in the United States from 1990 to 2016 



Figure 5.2 The reality: The American crime rate has been falling. 

Source: Adapted from FBI data aggregated from local law enforcement, www.statista.com/ 
statistics/191219/reported-violent-crime-rate-in-the-usa-since-1990 (Note, now available 
with 2017 data). 


Violent Victimization, 1993-2015 


Rate Per 1,000 Persons Age 12 or Older 



Figure 5.3 The reality: Crime victimization surveys confirm decreasing crime. 

Source: Adapted from the National Crime Victimization Survey, Bureau of Justice Statistics. 
www.bjs.gov/content/pub/pdf/ cvl 5 .pdf. 
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better (45% to 9%, respectively).” The National Academy of Sciences 
(2015) reports that this perception of crime-prone immigrants “is per¬ 
petuated by ‘issue entrepreneurs’ who promote the immigrant—crime 
connection in order to drive restrictionist immigration policy” (p. 326). 

Horrific rare incidents feed the narrative, as in the oft retold story of 
the Mexican national killing a young woman in San Francisco. Donald 
Trump’s (2015a) words epitomized the perception: “When Mexico 
sends its people . . . they’re bringing drugs. They’re bringing crime. 
They’re rapists.” “If we don’t get rid of these loopholes where killers 
are allowed to come into our country and continue to kill ... if we 
don’t change it, let’s have a shutdown,” said Trump (2018) as President. 
Much the same misinformation is spread by would-be dictators in 
Europe, such as Hungary’s Prime Minister Viktor Orban. 

Reality: Immigrants are not crime-prone. Immigrants who are poor and less 
educated may fit our image of criminals. Yet some studies find that, com¬ 
pared with native-born Americans, immigrants commit less violent crime 
(Adelman, Reid, Markle, Weiss, &Jaret, 2017; Butcher & Piehl, 2007; 
Riley, 2015). The same is true in Europe, in countries like Germany 
(Emery, 2016). “Immigrants are less likely than the native-born to com¬ 
mit crimes,” confirms a National Academy of Sciences report (2015). 
After analyzing incarceration rates, the conservative Cato Institute 
(2017) confirmed that “immigrants are less likely to be incarcerated than 
natives relative to their shares of the population. Even illegal immigrants 
are less likely to be incarcerated than native-born Americans” (p. 327). 
Noncitizens are reportedly 7% of the U.S. population and 6% of state and 
federal prisoners (KFF, 2017; Rizzo, 2018). Moreover, as the number 
of unauthorized immigrants has tripled since 1990 (Krogstad, Passel, & 
Cohn, 2017), the crime rate, as we have seen, plummeted. 

Perception: Unemployment worsened during the Obama presidency. In his pres¬ 
idential-bid announcement speech, Trump (2015b) declared that “Our 
real unemployment is anywhere from 18 to 20 percent.” Two-thirds of 
his seemingly gullible supporters told Public Policy Polling (2016b) that, 
yes, unemployment had increased during the Obama years. 

Reality: Following the recession-era doldrums that carried into Obama’s first 
year, unemployment steadily and substantially dropped (Figure 5.4; BLS, 
2017). By the time he left office, unemployment was down to 4.9% 
and some industries were facing a worker shortage. 

Perception: The stock market fell during the Obama presidency (Figure 5.5). In 
the same Public Policy survey, Trump supporters were equally divided 
on whether the stock market had risen or fallen during the Obama years 
(4 in 10 believed each, with the remainder being unsure). 

Reality: The stock market (S&P 500) nearly tripled during the Obama years. 


Psychological Science 81 



Month 


Figure 5.4 Unemployment rate during the Obama presidency. 

Source: Adapted from the Bureau of Labor Statistics. https://data.bls.gov/timeseries/LNS 
14000000 (Note: now updated a year). 



Figure 5.5 Stock market during the Obama presidency. 

Source: Adapted from S&P 500. www.barchart.com/stocks/quotes/$SPX/interactive-chart. 


These recent U.S. examples have a partisan tinge. And it’s true that sev¬ 
eral analyses found that the top fake news stories of the recent U.S. election, 
some planted by Russians, were similarly partisan (Hachman, 2017; Lee, 
2016). Thus, all evidence to the contrary, President Obama finished his 
time in office with 42% of Republicans still believing he was born in Kenya, 
making him ineligible to have been president (Zom, 2017). 
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Much gullibility is not so overtly partisan (NASA faked the moon land¬ 
ing; crashed UFO spacecraft are stored at Nevada’s Area 51; the Holocaust 
is a myth; see also on conspiracy theories Mayo, Chapter 8 this volume; 
van Prooijen, Chapter 17 this volume). Some bias is fostered by social sci¬ 
entists’ eagerness to believe claims that suit their (mosdy) progressive values 
(seejussim, Stevens, Honeycutt, Anglin, & Fox, Chapter 15 this volume). 
And much political bias is bipartisan. Peter Ditto and his colleagues (2015, 
2018) meta-analyzed the political bias literature and “found clear evidence 
of partisan bias in both liberals and conservatives, and at virtually identical 
levels.” Thus, both Democrats and Republicans tend to believe that, when 
their party holds the presidency, the president cannot control gas prices; 
when the opposing party is in power they believe the president can do so 
(Vedantam, 2012). Or consider Democratic partisan bias in Larry Bartels’ 
analysis (reported by FiveThirtyEight.com): 

[A] 1988 survey that asked “Would you say that compared to 1980, 
inflation has gotten better, stayed about the same, or gotten worse?” 
Amazingly, over half of the self-identified strong Democrats in the sur¬ 
vey said that inflation had gotten worse and only 8% thought it had 
gotten much better, even though the actual inflation rate dropped from 
13% to 4% during Reagan’s eight years in office. 

(Gelman, 2009) 

Other research teams have confirmed minor image bias (Brandt, 2017; 
Chambers, Schlenker, & Collisson, 2013; Crawford, Kay, & Duke, 2015). 
Whatever supports our views, we tend to believe; whatever contradicts our 
views, we tend to dismiss (see Cooper & Avery, Chapter 16 this volume). 
This humbling finding is a reminder of how easy it is (paraphrasing Jesus) 
to “see the speck in our neighbor’s eye” while not noticing the sometimes 
bigger speck in our own. 

Explaining Gullibility and Misinformation 

What explains the power of master manipulators, the striking embrace of 
false information, and various conspiracy theories (see Douglas, Sutton, & 
Cichocka, Chapter 4 this volume; van Prooijen, Chapter 17 this volume)? 


Fake News 

Some credulity feeds on plain fake news — what Nicholas Kristof (2016) 
called “lies in the guise of news.” France, Britain, and the United States, 
have all accused Russia of aiming to sway public opinion and elections with 
legitimate-looking, falsehood-spouting websites. Hence, shordy after the 
2016 election, Barack Obama (2016) warned that “If we can’t discriminate 
between serious arguments and propaganda, then we have problems.” 
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Pope Francis (2018) has deplored the infectious viral spread of fake news — 
“false information . . . meant to deceive and manipulate ... by appealing 
to stereotypes and common social prejudices, and exploiting instantaneous 
emotions like anxiety, contempt, anger, and frustration.” When emotion 
trumps evidence, gullibility ensues. And like the “crafty serpent” in the 
creation story, said Pope Francis, fake news uses mimicry (of real news) - a 
“sly and dangerous form of seduction that worms its way into the heart.” 

Some fake news spreads not from demagoguery, but less maliciously 
from mere satire that gullible people misinterpret, as in the Borowitz 
headline that “Trump Threatens to Skip Remaining Debates if Hillary 
is There,” which Snopes (2016) felt compelled to explain was a spoof. A 
famous radio play about a Martian landing was believed as real by mil¬ 
lions of people (see Cooper & Avery, Chapter 16 this volume). Snopes 
has also felt compelled to discount other satirical reports, some from The 
Onion, that, for example, 

• “Mike Pence said that he was disappointed in husbands and fathers for 
allowing women to participate in the Women’s March.” 

• “The Secret Service has launched an ‘emotional protection’ unit for 
President Trump.” 

• “Donald Trump announced plans to convert the USS Enterprise into a 
‘floating hotel and casino.’” 


Mere Repetition 

“Vaccines cause autism.” “Climate change is a hoax.” “Muslim terrorists pose 
a grave threat.” Never mind the facts - that, for example, of230,000 murders 
on U.S. soil since September 11, 2001, an infinitesimal proportion — 
123 by 2017 — were terrorist acts by Muslim Americans, with none com¬ 
mitted by terrorists born in the seven nations covered by Donald Trump’s 
proposed anti-terrorist travel ban (Kristof, 2017). In 2015 and again in 2016, 
toddlers (with guns) killed more Americans than terrorists (Ingraham, 2016; 
Snopes, 2015). 

Public gullibility about such myths is partly explained by “truth bias” — 
the disposition to believe others (Pantazi, Kissine, & Klein, 2018; Street 
& Kingstone, 2017) — and its amplification by the power of mere repeti¬ 
tion. 1 (See also Krueger, Vogrincic-Haselbacher, & Evans, Chapter 6 this 
volume; Strack, Chapter 9 this volume; Unkelbach & Koch, Chapter 3 
this volume). Much as mere exposure to unfamiliar stimuli breeds liking, 
so mere repetition can make things believable (Dechene, Stahl, Hansen, & 
Wanke, 2010; Moons, Mackie, & Garcia-Marques, 2009; Schwarz, Newman, 
& Leach, 2017). In elections, advertising exposure helps make an unfamil¬ 
iar candidate into a familiar one, which partially explain why, in U.S. con¬ 
gressional elections, the candidate with the most money wins 91% of the 
time (Lowery, 2014). 
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Hal Arkes (1990) has called repetition’s power “scary.” Repeated lies can 
displace hard truths. Even repeatedly saying that a claim is false can, when 
discounted amid other true and false claims, lead older adults later to mis- 
remember it as true (Skumik, Yoon, Park, & Schwarz, 2005). As we forget 
the discounting, our lingering familiarity with a claim can also make it seem 
credible. 

In the political realm, repeated misinformation can have a seductive 
influence (Bullock, 2006; Nyhan & Reifler, 2008). Recurring cliches 
(“Crooked Hillary”) can displace complex realities. George Orwell’s 
Nineteen Eighty-Four harnessed the power of repeated slogans: “Freedom is 
slavery.” “Ignorance is strength.” “War is peace.” Adolf Hitler understood: 
“All effective propaganda must be limited to a very few points and must 
harp on these in slogans” (Mein Kampf, 1926, ch. 6). 

Moreover, falsehoods fly fast. On Twitter, lies have wings. In one analy¬ 
sis of 126,000 stories tweeted by 3 million people, falsehoods - especially 
false political news — “diffused significantly farther, faster, deeper, and more 
broadly than the truth” (Vosoughi, Roy, & Aral, 2018). Compared to true 
stories, falsehoods often are more emotionally dramatic, novel, and seem¬ 
ingly newsworthy. As Jonathan Swift (1710) anticipated, “Falsehood flies, 
and the truth comes limping after it” (or in later renditions, “A lie can travel 
halfway around the world while the truth is putting on its shoes”). 

Retractions of previously provided information also rarely work — 
people tend to remember the original story, not the retraction (Ecker, 
Lewandowsky, Swire, & Chang, 2011; Lewandowsky, Ecker, Seifert, 
Schwarz, & Cooke, 2012; see also Krueger et al., Chapter 6 this volume). 
Courtroom attorneys understand this, which is why they will say something 
that might be retracted on objection, knowing the jury will remember it 
anyway. Better than counteracting a falsehood is providing an alternative 
simple story - and repeating that several times (Ecker et al., 2011; Schwarz, 
Sanna, Skumik, & Yoon, 2007; see also Mayo, Chapter 8 this volume; and 
van Prooijen, Chapter 17 this volume). 

Mere repetition of a statement not only increases its familiarity and our 
memory of it, but also serves to increase the ease with which it spills off our 
tongue (Unkelbach & Koch, Chapter 3 this volume). And with this increased 
fluency comes a sense of coherence and increased believability (McGlone & 
Tofighbakhsh, 2000; see also Oyserman, Chapter 14 this volume, on cultural 
fluency). Other factors, such as rhyming, further increase fluency and believ¬ 
ability. “Haste makes waste” says nothing more than “rushing causes mis¬ 
takes,” but it seems more true. What makes for fluency (familiarity, rhyming) 
also makes for believability. O. J. Simpson’s attorney understood this when 
crafting his linguistic slam dunk: “If [the glove] doesn’t fit, you must acquit.” 


Availability of Vivid (and Sometimes Misleading) Anecdotes 

In his astonishingly perceptive Novum Organuum, published in 1620, 
Francis Bacon anticipated the modern science of gullibility by identifying 
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“idols” or fallacies of the human mind. Consider, for example, his des¬ 
cription of what today’s psychological scientists know as the availabil¬ 
ity heuristic - the human tendency to estimate the commonality of an 
event based on its mental availability (often influenced by its vividness 
or distinctiveness): 

The human understanding is most excited by that which strikes and 
enters the mind at once and suddenly, and by which the imagination 
is immediately filled and inflated. It then begins almost imperceptibly 
to conceive and suppose that everything is similar to the few objects 
which have taken possession of the mind. 

(Bacon, 1620, n.p.) 

As Gordon Allport (1954, p. 9) said, “Given a thimbleful of [dramatic] 
facts we rush to make generalizations as large as a tub.” To persuade peo¬ 
ple of the perils of immigration and the need to “build the wall,” Donald 
Trump repeatedly told the vivid story of the previously deported home¬ 
less Mexican who fired a gun killing a San Francisco woman. (The bullet 
actually ricocheted off the ground, and the man was found not guilty.) 
The political use of dramatic anecdotes is bipartisan, as illustrated when the 
wrongful detaining of Australian children’s author Mem Fox at Los Angeles 
Airport triggered progressive’s outrage over Trump administration border 
policies. But with 51 million nonresident tourists entering the United States 
each year, it behooved us to remember that, as we social scientists are fond 
of saying, “the plural of anecdote is not data.” 

The staying power of vivid images contributes to misperception that 
crime has been increasing. In 2015, six of the top ten Associated Press news 
stories were about gruesome violence (Bomstein & Rosenberg, 2016). 
“If it bleeds, it leads.” Small wonder that Americans grossly overestimate 
their vulnerability to crime and terror. And not just Americans. In one 
survey of people across 30 countries, 1.8% of people reported experiencing 
a completed burglary in the prior year. And 29% of people thought they 
were likely or very likely to be burglarized during the next year (van Dijk, 
Kesteren, & Smit, 2007). 

In other ways, too, we fear the wrong things. We exhibit probabil¬ 
ity neglect as we worry about unlikely possibilities while ignoring higher 
probabilities. As Bacon observed (1620), “Things which strike the sense 
outweigh things which do not immediately strike it, though they be more 
important” (n.p.). Thanks to cognitively available images of airplane 
crashes, we may feel more at risk in airplanes than in cars. In reality, from 
2010 through 2014, U.S. travelers were nearly 2,000 times more likely to 
die in a car crash than on a commercial flight covering the same distance 
(National Safety Council, 2017). In 2017, there were no fatal commer¬ 
cial jet crashes anywhere in the entire world (BBC, 2018). For most air 
travelers, the most dangerous part of the journey is the un-scary drive to 
the airport. 
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After 9/11, as many people forsook air travel for driving, I estimated 
that if Americans flew 20% less (as airline data indicated) and instead 
drove half those unflown miles, we could expect an additional 800 traffic 
deaths in the ensuing year (Myers, 2001). Gerd Gigerenzer (2004, 2010) 
later checked that prediction against U.S. traffic accident data. The data 
confirmed an excess (compared to the prior five years) of some 1,595 
deaths in the year following 9/11 — people who “lost their lives on the 
road by trying to avoid the risk of flying” (Gigerenzer, 2010, p. 96). 
Ergo, the terrorists appear to have killed, unnoticed, six times more peo¬ 
ple on America’s roads than they did with the 265 fatalities of those flying 
on those four planes. 

In 2018, school shootings understandably captured attention, leading 
some schools to have children practice huddling in closets during active 
shooter drills. Protecting children is appropriately a high priority. Yet 
Harvard risk expert David Ropeik (2018) calculates that the likelihood of 
any given school student being killed by a gun on any given day is incom¬ 
prehensibly small — 1 in 614,000,000 — “far lower than almost any other 
mortality risk a kid faces, including traveling to and from school” or playing 
sports. “Statistics seem cold and irrelevant,” acknowledges Ropeik. But, he 
argues, exaggerated fears of an “extraordinarily rare risk” do their own form 
of harm to children’s security and well-being. 

When estimating risks, reasonable people should, of course, seek data. 
Yet cognitive availability often predominates, as was illustrated one morn¬ 
ing after I awoke at an airport hotel where I had been waylaid after a flight 
delay. The nice woman working the breakfast bar explained how, day 
after day, she met waylaid passengers experiencing weather problems, crew 
delays, and mechanical problems. Her conclusion (from her mentally avail¬ 
able sample): Flying so often goes awry that if she needed to travel she 
would never fly. 

Not-gullible people should likewise seek data when assessing global cli¬ 
mate change: “Over time, are the planet air and seas warming? Are the 
polar ice caps melting? Are vegetation patterns changing? And should accu¬ 
mulating atmospheric C0 2 lead us to expect such changes?” Yet thanks 
to the availability heuristic, dramatic weather events make us gasp, while 
such global data we hardly grasp. Thus, people’s recent weather experience 
contaminates their beliefs about the reality and threat of climate change 
(Kaufman et al., 2017). People express more belief in global warming, and 
more willingness to donate to a global warming charity, on warmer-than- 
usual days than on cooler-than-usual days (Li, Johnson, & Zaval, 2011; 
Zaval, Keenan, Johnson, & Weber, 2014). A hot spell increases people’s 
worry about global warming, while a cold day reduces their concern. In one 
survey, 47% of Americans agreed that: “The record snowstorms this winter 
in the eastern United States make me question whether global warming 
is occurring” (Leiserowitz, Maibach, Roser-Renouf, & Smith, 2011). But 
then, after an ensuing blistering summer, 67% agreed that global warming 
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helped explain the “record high summer temperatures in the U.S. in 2011” 
(Leiserowitz, 2011). A tweet from Comedian Stephen Colbert (2014) gets 
it: “Global warming isn’t real because I was cold today! Also great news: 
world hunger is over because I just ate.” 


Confirmation Bias and Self-Justification 

Bacon’s (1620) Novum Organum human fallacies also included our tendency 
to welcome information that supports our views, and to discount what 
does not: “The human understanding, when any proposition has been 
once laid down (either from general admission and belief, or from the 
pleasure it affords), forces everything else to add fresh support and confir¬ 
mation” (n.p.). Reflecting on his experiments demonstrating this human 
yen to seek self-supporting evidence (the confirmation bias), Paul Wason 
(1981) concludes that “Ordinary people evade facts, become inconsistent 
or systematically defend themselves against the threat of new information 
relevant to the issue” (p. 356). So, having formed a belief - that climate 
change is real (or a hoax), that gun control does (or does not) save lives, 
that people can (or cannot) change their sexual orientation - people selec¬ 
tively expose themselves to belief-supportive information (see also Cooper 
& Avery, Chapter 16 this volume). Our minds vacuum up supportive 
information. To believe is to see. 

Confirmation bias and selective exposure give insight into the striking 
result of a May 2016 Public Policy Polling survey (2016a). Among voters 
with a favorable view of Donald Trump (a subset of Republicans), most 
believed Barack Obama was Muslim rather than Christian (65% vs. 13%). 
Among voters with an unfavorable view of Trump, the numbers were 
reversed (13% vs. 64%). Since both can’t be right, the survey again displays 
gullibility writ large. And in the year after Trump’s inauguration, anti- and 
pro-Trump people could read reports of Trump campaign contacts with 
Russia and reach similarly opposite conclusions of either “collusion” or “a 
nothing burger.” 

A sister phenomenon, self-justification, further sustains misinformation 
(see also Dunning, Chapter 12 this volume). To believe is also to justify 
one’s beliefs. This was dramatically evident in U.S. national surveys sur¬ 
rounding the Iraq war. As the war began, 4 in 5 Americans supported 
the war - on the assumption that Iraq had weapons of mass destruction, 
though only 38% said the war would be justified if there were no such 
weapons (Duffy, 2003; Newport, Moore, Jones, & Saad, 2003). When the 
war was completed without any discovery of WMDs, 58% now justified 
the war even without such weapons (Gallup, 2003). “Whether or not they 
find weapons of mass destruction doesn’t matter,” suggested Republican 
pollster Frank Luntz (2003), “because the rationale for the war changed.” 
As Daniel Levitin (2017) observed in Weaponized Lies, “The brain is a very 
powerful self-justifying machine” (p. 14). 
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Confirmation bias and self-justification are both driven by people’s 
motives. Motives matter, emphasize Stephen Lewandowsky and Klaus 
Oberauer (2016): “Scientific findings are rejected . . . because the science 
is in conflict with people’s worldviews, or political or religious opinions” 
(p. 217). Thus, a conservative libertarian who cherishes the unregulated 
free market may be motivated to ignore evidence that government regu¬ 
lations serve the common good - that gun control saves lives, that man¬ 
dated livable wages and social security support human flourishing, that 
future generations need climate-protecting regulations. A liberal may be 
likewise motivated to discount science regarding the toxicity of teen por¬ 
nography exposure, the benefits of stable co-parenting, or the innova¬ 
tions incentivized by the free market. Again, Bacon (1620) foresaw the 
point: “The human understanding is no dry light, but receives an infu¬ 
sion from the will and affections . . . For what a man had rather were true 
he more readily believes” (n.p.). 


Statistical Illiteracy 

Our human powers of evolutionary determined, automatic information 
processing feed our intuition (see Baumeister, Chapter 2 this volume). As 
car mechanics and physicians accumulate experience, their intuitive exper¬ 
tise often allows them to quickly diagnose a problem. Chess masters, with 
one glance at the board, intuitively know the right move. Japanese chicken 
sexers use acquired pattern recognition to separate newborn pullets and 
cockerels with instant accuracy. And for all of us, social experience enables 
us, when shown but a “thin slice” of another’s behavior, to gauge then- 
energy and warmth. 

Human intuition has powers, but also perils. “The first principle,” said 
physicist Richard Feynman (1974), “is that you must not fool yourself- 
and you are the easiest person to fool.” In hundreds of experiments, peo¬ 
ple have overrated their eyewitness recollections, their interviewee assess¬ 
ments, and their stock-picking talents. Often we misjudge reality, and 
then we display belief perseverance when facing disconfirming information. 
As one unknown wag said, “It’s easier to fool people than to convince 
them they have been fooled.” For this gullibility, our statistical intuition 
is partly to blame. 


Probability Neglect 

Consider, for example, how statistical illiteracy and misinformation feed 
health scares (Gigerenzer, 2010). In the 1990s, the British press reported 
that women taking a particular contraceptive pill had a 100% increased risk 
of stroke-risking blood clots. This caused thousands of women to stop tak¬ 
ing the pill, leading to many unwanted pregnancies and 13,000 additional 
abortions (which were also linked with increased blood-clot risk). A study 
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indeed had found a 100% increased risk — but a nominal increase from 1 in 
7,000 to 2 in 7,000. 

In one study, Gigerenzer (2010) showed how gullibility crosses educa¬ 
tional levels. He invited people to estimate the odds that a woman had breast 
cancer, given these facts: Among women in her age group, 1% had bre¬ 
ast cancer. If a woman had breast cancer, the odds were 90% that a mam¬ 
mogram would show a positive result. Now imagine a woman had a positive 
mammogram. What is the probability that she had breast cancer? This simple 
question stymied even physicians, who gready overestimated her risk. 

But consider the same information framed with more transparent natural 
numbers: Of every 1,000 women in this age group, 10 had breast cancer. 
Of these 10, 9 will have a positive mammogram. Among the other 990 who 
don’t have breast cancer, some 90 will have a false positive mammogram. 
So, again, what is the probability that a woman with a positive mammogram 
had cancer? Given the natural numbers, it becomes easier to see that among 
the 100 or so women receiving a positive result, only 10, or about 1 in 10, 
actually had breast cancer. 


Perceiving Order in Random Events 

“The human understanding,” said Bacon (1620), is “prone to suppose the 
existence of more order and regularity in the world than it finds” (n.p.). 
In our eagerness to make sense of our world, we see patterns. People may 
perceive a face on the Moon, hear Satanic messages in music played back¬ 
ward, or perceive Jesus’ image on a grilled cheese sandwich. It is one of the 
curious facts of life that even in random data, we often find order (Falk, & 
Ay ton, 2009; Nickerson, 2002, 2005). 

Random sequences seldom look random because, more than people 
expect, they contain streaks. Coin tosses have more runs of heads and of tails 
than people expect from random coin tosses. Likewise, basketball-shooting 
and baseball-hitting outcomes that mimic random coin tossing appear to 
have “hot” or “cold” streaks for which sports fans have ready explanations - 
as if there were something to explain (Gilovich, Tversky, & Vallone, 1985; 
Reifman, 2011). And as Burton Malkiel’s many editions of A Random Walk 
Down Wall Street document, stock pickers are similarly tempted to see pat¬ 
terns in random data and to overestimate their ability to beat the efficient 
marketplace. 

As determined pattern-seekers, we therefore sometimes fool ourselves. 
We see illusory correlations. We perceive causal links where there are none. 
We may even make sense out of nonsense, by believing that astrological 
predictions predict the future, that gambling strategies can defy chance, or 
that superstitious rituals will trigger good luck. As Bacon (1620) recognized, 
“All superstition is much the same . . . deluded believers observe events 
which are fulfilled, but neglect and pass over their failure, though it be 
much more common” (n.p.). 
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Misinterpreting Regression Toward the Mean 

Another common source of gullibility is our natural underappreciation of 
statistical regression. Because average results are more typical than extreme 
results, we may expect that, after an unusual event, things will tend to 
regress (return) toward their average level. Extraordinary events tend to be 
followed by more ordinary ones. 

Failure to recognize such regression feeds superstitions and ineffec¬ 
tive practices. When day-to-day behavior contains chance fluctuation, 
we may notice that others’ behavior improves (regresses toward average) 
after we criticize them for an unusually bad performance, and that it 
worsens (regresses toward average) after we praise them for an excep¬ 
tionally fine performance. Ironically, then, regression toward the average 
can mislead us into feeling rewarded for having criticized others and into 
feeling punished for having praised them (Tversky & Kahneman, 1974). 
Coaches who berate their teams at halftime after an exceptionally bad 
performance will tend to feel rewarded with a more normal second 
half performance, and vice versa for those who lavish praise after an out¬ 
standing first half performance. 

Group Polarization 

Human gullibility feeds on fake news, mere repetition, vivid anecdotes, 
self-confirming assessments, self-justification, and statistical misinforma¬ 
tion, and is then further amplified as people network with like-minded 
others. In one of my early experiments with George Bishop, high- and 
low-prejudice high school students were grouped with kindred spirits 
for discussion of racial issues, such as a case of property rights clashing 
with open housing. Our finding, and that of many other experiments 
since, was that like minds polarize (Figure 5.6; Myers & Bishop, 1970). 
Separation + conversation polarization. 

This group polarization phenomenon — discussion magnifying a group’s pre¬ 
existing leanings — helps fuel both public good (when benevolent tenden¬ 
cies strengthen) and evil (from gang delinquency to terrorism). As with hot 
coals, like minds strengthen one another. 

In communities, like minds are segregating more and more. Progressive 
places have attracted progressive people, and become more progressive. 
Ditto conservative places. Thus the percentage of Americans living in 
landslide counties — those with 60+% voting for the same presidential 
candidate — rose from 38% in 1992 to 60% in 2016 (Aisch, Pearce, & 
Yourish, 2016). And the proportion of entering collegians describing 
themselves as politically “middle of the road” dropped from 60% in 1983 
to 42% in 2016 — with corresponding increases in those with “far left” and 
“far right” identities (Eagan et al., 2017; Twenge, Honeycutt, Prislin, & 
Sherman, 2016). 
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Figure 5.6 Group polarization. Attitudes polarized when students discussed racial 
issues in separated small groups of those with high and low prejudice. 

Source: Myers and Bishop (1970). 


As I cut my eyeteeth in social psychology with studies of group polari¬ 
zation, I did not foresee the creative possibilities or potential dangers of 
polarization enabled by social media, with liberal and conservative websites 
linking people mostly to kindred sites (Figure 5.7; Lazer et al., 2009). The 
Internet enables cancer survivors and conspiracy schemers to congregate 
with like-minded others and to share support for their shared aspirations and 
suspicions. With customized news feeds, retweets, and self-selections from a 
varied news buffet, we devour information — and misinformation (Bakshy, 
Messing, & Adamic, 2015; Barbera, Jost, Nagler, Tucker, & Bonneau, 
2015). “Dear Satan,” tweeted Steve Martin (2016), “thank you for having 
my internet news feed tailored especially for ME!” 

Within this echo chamber of the like-minded, group polarization hap¬ 
pens. Therefore, what begins as gullibility may become toxic. Views become 
more extreme. Suspicion may escalate into obsession. Disagreements with 
the other tribe can intensify to demonization. Disapproval may inflate 
to loathing. 
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Figure 5. 7 Liberal and conservative websites network mostly with one another. 
Source: Adapted from Lazer et al. (2009). 


Overconfidence 

The result of gullibility-producing biases and polarization is overconfidence 
in one’s own wisdom. Such overconfidence - what researchers have called 
cognitive conceit - comes naturally. For example, when people’s answers to 
factual questions — “Which is longer, the Panama or the Suez Canal?” “Is 
absinthe a liqueur or a precious stone?” — are correct 60% of the time, they 
will typically feel 75% confident (Fischhoff, Slovic, & Lichtenstein, 1977; 
Metcalfe, 1998; see also Dunning, Chapter 12 this volume). 

Overconfidence — the bias that Daniel Kahneman (2015), if given a 
magic wand, would most like to eliminate — feeds political misjudgment. 
Philip Tetlock (1998, 2005) gathered 27,000+ expert predictions of world 
events, such as whether Quebec would separate from Canada, or the 
future of South Africa. His finding: Like stock brokers, gamblers, and 
everyday citizens, they were more confident than correct. The experts’ 
predictions, made with 80% confidence on average, were right less than 
40% of the time. 

Citizens with a shallow understanding of complex proposals, such as cap- 
and-trade or a flat tax, may nevertheless express strong views. As the now- 
famous Dunning-Kruger effect reminds us, incompetence can ironically feed 
overconfidence (Kruger & Dunning, 1999; see also Dunning, Chapter 12 
this volume). The less people know, the less aware they are of their own 
ignorance and the more definite they may sound. Asking them to explain 
the details of these policies exposes them to their own ignorance, which 
often leads them to express more moderate views (Fembach, Rogers, Fox, 
& Sloman, 2013). “No one can see his own errors,” wrote the Psalmist 
(19:12, GNB). But to confront one’s own ignorance is to become wiser. 
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Conclusion: Gullibility and Humility 

This enumeration of the roots of gullibility could be extended with expla¬ 
nations of the anchoring effect, belief perseverance, the false consensus 
phenomenon, issue framing, the fundamental attribution error, hindsight 
bias, illusory correlations, implicit associations, in-group bias, the just- 
world phenomenon, memory construction, mood-congruent memories, 
perceptual illusions, self-serving perceptions, implicit associations, in¬ 
group bias, the representativeness heuristic, and more. But this has been 
enough to appreciate that Pascal was right: “The human understanding is 
like a false mirror.” 

We can acknowledge human gullibility while still respecting our remark¬ 
able information-processing powers - appreciating, with Shakespeare’s 
Hamlet, “in apprehension how like a god!” Our species is smart enough to 
have invented talking computers, cracked our genetic code, and traveled to 
the moon. Three cheers for our human brilliance. 

Or maybe two cheers, because our mind’s premium on efficiency enables 
us, with striking ease, to adapt successfully but also to form and sustain false 
beliefs. “The naked intellect,” observed novelist Madeline L’Engle (1973, 
p. 87), “is an extraordinarily inaccurate instrument.” 

For this, science, education, and religion each offer remedies. 

Science encourages a marriage of open curiosity with skepticism. “If you 
are only skeptical,” noted Carl Sagan (1987), “then no new ideas make it 
through to you.” But a smart mind also restrains gullibility by thinking criti¬ 
cally. It asks, “What do you mean” and “How do you know”? “Openness 
to new ideas, combined with the most rigorous, skeptical scrutiny of all 
ideas, sifts the wheat from the chaff,” Sagan (1996, p. 31) added. 

Education is an antidote to what Sagan (1996) feared - a future for his 
grandchildren in which “our critical faculties in decline, unable to distin¬ 
guish between what feels good and what’s true, we slide, almost without 
noticing, back into superstition and darkness” (p. 25). Happily, education 
works. It can train people to recognize how errors and biases creep into 
their thinking (Nisbett, 2015; Nisbett & Ross, 1980). It can engage ana¬ 
lytic thinking: “Activate misconceptions and then explicitly refute them,” 
advise Alan Bensley and Scott Lilienfeld (2017; see also Chan, Jones, Hall 
Jamieson, & Albarracin, 2017). It can harness the powers of repetition, 
availability, and the like to teach true information (Schwarz et al., 2017). 
And thus, at the end of the day, it can and does predict decreased gullible 
acceptance of conspiracy theories (van Prooijen, 2017). 

Finally, religion can provide a deep rationale for the humility that under¬ 
lies science and critical thinking. All varieties of theism assume that (1) there 
is a God, and (2) it’s not you or me. As fallible creatures we should therefore 
hold our own beliefs tentatively (our surest conviction can be that some of 
our beliefs err). We should assess others’ ideas with open-minded skepticism. 
And when appropriate, we should use observation and experimentation to 
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winnow truth from error. As St. Paul advised (1 Thessalonians 5:21), “Test 
everything, hold fast to what is good.” Truth matters. 

Note 

1 As Ruth Mayo (Chapter 8 this volume) shows, in some contexts an opposite mis¬ 
trust bias appears — leading people to discount valid information and to disbelieve 
credible sources as fake news. 
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Politicians are not known for putting a premium on truth, yet they seek 
to appear as if they did. George W. Bush famously asserted that “there’s an 
old saying in Tennessee - I know it’s in Texas, probably in Tennessee - 
that says, fool me once, shame on - shame on you. Fool me - you can’t 
get fooled again.” 1 Bush may have fooled his fellow Americans many 
times, but he did not fool everyone all the time. Occasionally, evidence 
contrary of what he asserted punched through. His claim that Iraq har¬ 
bored weapons of mass destruction (WMD) at the time the United States 
was preparing for war was not substantiated - to the point that the absence 
of evidence amounted to evidence of absence (Hartnett & Stengrim, 
2004). Of course, the evidence (or lack thereof) did not move all minds. 
Even today, some people feel that Saddam Hussein had such weapons 
stashed away somewhere (Hochschild & Einstein, 2015). These believers 
may point to the fact that Saddam did use WMD on citizens of his own 
country when unleashing poison gas on the Kurds. If WMD were found, 
dedicated minds might argue that the CIA had planted these weapons in 
order to reconcile ordinary American minds with the idea of war. As long 
as an idea is neither theoretically impossible nor empirically disproven, 
even David Hume or Thomas Bayes can only ask for skepticism but not 
outright disbelief. 

As a low-stakes example, consider a social media post in which one of 
the authors (JIK) announced his departure from academia for the corporate 
world. Some of his friends wished him well, whereas others expressed puz¬ 
zlement. Responding to a call from his superego, JIK eventually revealed 
his jocular intent. Humor is a risky form of gullibility play. The humorous 
guller must trust the gullees to “get it.” The humorous guller must, in other 
words, temporarily disable the Gricean norm of truthfulness. By contrast, 
the serious guller strategically leverages the Gricean norm, thereby debasing 
it. Hence, the issue of gullibility can be framed as a dilemma or as a dialectic. 
This is the approach we take in this chapter. 
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The Gullibility Game 

Parents tell their children - much as pastors, rabbis, schoolteachers, and 
insurance salespeople tell the rest of us — “thou shalt not lie!” Deontological 
imperatives are a culture’s way of creating consent at low cost (Baron, 2012; 
see Forgas, Chapter 10 this volume; Oyserman, Chapter 14 this volume). 
These imperatives ask us not to think and reflect, but to engage the unques¬ 
tioning, reflexive capacity of mind. This tends to work well enough to hold 
society together, but, as game theory teaches, being truthful is not a domi¬ 
nating strategy (Binmore, 2007). You will not be better off by being truthful 
irrespective of whether others lie. Nor is lying a dominating strategy in the 
way that defection is in the prisoner’s dilemma. Kant solved the dilemma 
after a fashion by ignoring the material consequences and pronouncing 
truthfulness the moral choice. 

Living humans, however, who worry about consequences, may con¬ 
sider the assurance game, also known as the “stag hunt” (Rousseau, 
1754/1984), as a model of trust and gullibility (Krueger, Evans, & Heck, 
2017). In the assurance game, the payoff matrix of which is shown in 
Figure 6.1, both players recognize that mutual cooperation (telling the 
truth) yields the best outcome for all. However, a player who believes 
that the other might defect (lie) will him- or herself defect, thereby con¬ 
firming this very fear for the other. In other words, a player might doubt 
that the other will cooperate if the other player fears that this first player 
might have that fear, and so on. The assurance game has no dominating 
strategy, but in repeated play a strategy of tit for tat (“equivalent retalia¬ 
tion”) is an effective way to settle into a mutually beneficial exchange of 
cooperative behavior (Axelrod, 1984). When speech acts are exchanged, 
tit for tat gives the benefit of the doubt. Speak the truth unless you are 
lied to. Alas, we often don’t know at first whether we are being lied to. 
We must apply personal standards of how much credence to grant a claim 
when the claimant’s intentions are veiled (Harris, Koenig, Corriveau, & 
Jaswal, 2018). 
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2,2 

0 , 1 

1,0 

1 , 1 


Figure 6.1 The assurance game in matrix form. Higher numbers indicate more 
preferred outcomes. 
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Gullibus Dialecticus 

A dialectic is a potential intellectual impasse, a fanciful way of saying “it’s 
complicated,” but with a hope of resolution. If we cannot trust all claims 
all the time for fear of being gulled, how do we know the difference? If 
gullibility is the thesis and skepticism is the antithesis, how do we find a 
synthesis? To say “believe the credible” is to beg the question of how we 
know what is credible. Psychological science is flush with theories of animal 
learning (Church, 1963), deep learning (LeCun, Bengio, & Hinton, 2015), 
very deep learning (Simonyan & Zisserman, 2014), and machine learning 
(Rasmussen, 2004). All these theories assume the existence of honest feed¬ 
back. The signal may come with noise, and perception and memory may be 
imperfect, but the feedback is rarely allowed to be strategic - unless experi¬ 
menters lie to their participants. 2 

Epistemology and Induction 

Being skeptical during the generally optimistic era of the enlightenment, 
Hume explored the phenomenon of gullibility. In his essay on miracles, 
he maintained that extraordinary claims require extraordinary evidence 
(Hume, 1748/1959). Setting this high standard for the verification of a mir¬ 
acle, he assigned it a low probability of occurring. For a claim of a miracle 
to be accepted, the probability of the claim being fake — by mistake or by 
design — must be lower still. Hume advised that we should not accept such 
claims lightly; the fact that beliefs in miracles are not uncommon suggests 
that Hume’s rule has normative force (Hajek, 1995). 

The same holds for Bayes’ rule, although Bayes was not concerned with 
lying. Bayes’ equation, which shows the relations among conditional and 
unconditional probabilities, is normative in the mathematical sense. Thou 
shalt not violate Bayes’ theorem lest thou be incoherent. In psychological 
science, Bayes’ theorem is often accepted as a norm of thinking (Edwards, 
Lindman, & Savage, 1963). Thou shalt think in the Bayesian way lest thou 
be irrational (Dawes, 1988). The psychological idea implicit in Bayes is 
seemingly beyond reproach. Belief — broadly defined as a person’s subjec¬ 
tive sense of the likelihood of an assertion being true — should be sufficiently 
determined by prior belief and evidence — in multiplicative fashion. The 
strength of the prior belief may be expressed as a likelihood or a probability, 
p(B), and the strength of the evidence is expressed by the ratio of the likeli¬ 
hood of the evidence assuming that the belief in question is true, p(D | B), 
over the cumulative likelihood of the evidence under all conceivable beliefs, 
p(D). When only two mutually exclusive and exhaustive beliefs are in play 
(“The aliens either landed or they did not”), the latter term reduces to the 
sum of the likelihood of the evidence assuming that the belief is true plus 
the likelihood of the evidence assuming that the belief is false. 

Bayes’ theorem and the human judgment it informs work well when the 
numbers are on the table, either as probabilities or as frequencies (Gigerenzer 
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& Hoffrage, 1995). Basic rationality is assumed in that the human judges are 
not expected to bicker over the numbers. They only need to know how to 
divide and multiply. Although Bayesian theories model subjectivity, they 
demand consensus on what the data are. Subjectivity is placed in the term 
p(B); it may vary over judges. The evidence, or the data, D, is objective. 
Thus, the term p(D|B) is objective. The assumption that humans honor 
the objectivity ofp(D|B) shows the optimism of the enlightenment. Yet, 
human cognition and perception are subject to motivations and cognitive 
constraints, so much so that a value of, say, .05 for p(D | B) means different 
things to different people (see Myers, Chapter 5 this volume). 

A third approach is decision theoretic (Swets, Dawes, & Monahan, 
2000). After Hume and Bayes, we meet Pascal (Hajek, 2003; Krueger, 
2011b). Here too, we find a family of models and techniques, but the basic 
idea is simple. Decisions bisect reality so that the decision to endorse belief 
B amounts to a true positive, or a “hit,” if that belief is true. If this belief 
is not true, the result is a false-positive error. If the decision is to reject B, 
but B is true, the result is a false-negative error, or “miss.” If B is rejected 
and it is false, the result is a “correct rejection.” A simple epistemic goal 
is to maximize accuracy by reducing the overall proportion of erroneous 
decisions. If, however, the relative values assigned to the four possible out¬ 
comes vary, so should the decision threshold or bias to endorse the belief. 
Following this logic, Pascal wagered to believe in God, considering it more 
painful to reject an existing god than to believe in a non-existing one. Pascal 
was a belief-liberal. 

By contrast, conventional significance testing is belief-conservative as it 
is biased against beliefs in the non-existent. Here, the term p(D | B) refers to 
the p value associated with the test statistic. Only if p < .05, the researcher 
rejects the idea of nothing, or nullness, tentatively inferring that there is 
systematic variance (an effect!) (Krueger et al., 2017). Significance testing 
is the researcher’s way of checking gullibility. There is intense debate as to 
whether the protections against being gulled by the data (or naive or nefari¬ 
ous investigators) are sufficient, which reinforces the idea that most people 
(lay and academic alike) tend to have a greater fear of believing something 
that is not there than of missing something that is (Ioannidis, 2014). Perhaps 
these fears are so strong because the evidence - mostly obtained with sig¬ 
nificance testing - suggests that people hold a far greater portfolio of beliefs 
than they should (see Jussim, Stevens, Honeycutt, Anglin, & Fox, Chapter 
15 this volume). 

The common subtext to these induction methods, be they Humean, 
Bayesian, and Neyman-Pearsonian (excepting Pascal himself), is that lay 
epistemology is too liberal, thereby underwriting gullibility. Formal meth¬ 
ods of induction must teach the human observer to stick to the evidence. 
These formal methods have had a greater impact on scientific work than 
on everyday thinking. Ordinary thinking departs from formal epistemolo¬ 
gies in two seemingly contradictory ways. One way is simple gullibility, 
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which is the unreflective willingness to believe a claim. The other way is 
conditional gullibility, which is the tendency to assimilate evidence to pre¬ 
existing beliefs. Let us consider the two in turn. 

The Power of the Given Stimulus 

Following Spinoza, Gilbert (1991) proposed that comprehending a claim 
and believing it are initially one and the same. To comprehend X, we must 
first believe X, if only for a moment. Middle school graffiteurs who write, 
“Wer dies best ist doof’ (“He - or she - who reads this is dumb”) under¬ 
stand this (see Schwarz & Lee, Chapter 13 this volume). Doubt, skepticism, 
and eventual disbelief require mental work and thus time. The claim X 
must be situated within a mental network of relevant propositions, and the 
coherence of this network must be checked. If adding X to the network of 
beliefs reduces the network’s coherence, X may be tagged as being negated. 
Psychologically, this tagging amounts to a verdict of “not true” rather than 
“false.” Gilbert’s theory is not statistical, but perceptual and cognitive. It 
treats gullibility as the result of the mental system’s default operation, which 
can only be removed after careful consideration of contrary evidence. 

Gilbert’s (1991) dual-process approach captures only part of the general 
decision-theoretic model. As his approach focuses on the role of reflective 
cognition for the identification and the removal of false-positive errors, it 
limits good thinking to the transformation of false positive beliefs into cor¬ 
rect rejections. False negatives remain unknown, and therefore any assess¬ 
ment of accuracy as the statistical association between belief (vs. unbelief) 
and reality (true vs. false) remains undefined. Gilbert’s (1991) theory of 
belief was an early example of a dual-process theory, which has swept psy¬ 
chology since (see also Strack, Chapter 9 this volume; Unkelbach & Koch, 
Chapter 3 this volume). Many of the heuristics proposed in Kahneman and 
Tversky’s groundbreaking work came to be reinterpreted in dual-process 
or dual-systems terms (Kahneman, 2011; but see Dawes, 1976, for an early 
dissent). A latecomer to dual systems, Kahneman suggested that fast, intui¬ 
tive thinking is perceptual in nature, whereas slow, deliberative thinking 
represents what is ordinarily considered reasoning. Errors, and irrationality 
more generally, occur when the intuitive system generates a wrong response 
and when the deliberative system fails to correct it. 

Viewed this way, gullibility flourishes where heuristic reasoning reigns. 
Anchoring is the effect of an initial stimulus on eventual judgment. The 
effect is dramatic, as it can occur even when the anchor is extreme or com¬ 
ing from randomness (Frederick & Mochon, 2012; Tversky & Kahneman, 
1974). Gullers can use anchoring to induce gullees to accept beliefs that 
are more extreme than they would be or should be without the anchor. 
Deliberative thinking works to mitigate the anchor’s effect, but insuffi- 
ciendy so (Epley & Gilovich, 2006; see Dunning, Chapter 12 this volume). 
Representative thinking is equally well documented. Gullers can induce 
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false beliefs by using evocative imagery, which leads to false judgments if 
these images contradict statistical considerations. Magicians and charlatans 
are fond of providing audiences with visual, experiential demonstrations, 
seeking to disable slow thinking about coherence and probability. What 
Kahneman and Tversky (1982) called the simulation heuristic capitalizes 
on the power of story and narrative. Humans are gulled by good stories, 
that is, stories that have a dramatic arc, reveal causal relations, and tell about 
the reasons and intentions of human agents (Pennington & Hastie, 1993; 
Schank & Abelson, 1995). Narrative cognition bestows many benefits, not 
least among them boosted memory (Bartlett, 1932/1997). Again, however, 
gullers can exploit the human readiness for the narrative by weaving decep¬ 
tive stories that satisfy these criteria but that happen to be utterly false. Belief 
is beggared if one cares to look. 

If heuristics threaten rationality and foster gullibility, we begin to see 
the connection between the two. Both ought to be overcome by slow 
and careful thinking, but often are not. As Amos Tversky once put it in 
conversation with creativity scholar Victor Shamas, “the only thing that 
matters is what’s on your mind - not what’s in it” (Shamas, 2018, p. 162). 
The stress is to be imagined on the preposition “on.” Tversky was alluding 
to the dominance of the salient stimulus (cf. Dawes, 1988). Many judgmen¬ 
tal heuristics — with the exception of the story heuristic perhaps — may be 
bundled due to this critical feature. People are liable to be gullible if they 
fail to go beyond whatever stimulus is right in front of them (Posner, 1973). 
Uncorrected, their judgments show focalism and nonregressiveness (Fiedler 
& Krueger, 2012). Social and cognitive psychology has produced a wealth 
of evidence for a variety of processes that can be subsumed under this rubric. 
To name a few; stimuli become more salient (and thus gulling) if they are 
novel, surprising, or familiar (Pennycook & Rand, 2017), if they are vividly 
imagined or causally explained (Gregory, Cialdini, & Carpenter, 1982), or 
if people fail to question them (mindlessness; Langer, Blank, & Chanowitz, 
1978; see also Forer, 1949). Through various associative processes, salient 
stimuli affect judgment and inference more broadly. Salient stimuli become 
emotionally significant through evaluative conditioning (Hiitter, Sweldens, 
Stahl, Unkelbach, & Klauer, 2012) and diagnostic (or pseudo-diagnostic) 
of other dimensions through statistical contingency (Fiedler, Freytag, & 
Meiser, 2009; Rothbart, 2015/1981). 

Whatever makes a stimulus salient and focal is not necessarily indicative 
of truth, although there may be probabilistic relationships. If a correction is 
needed, how can it be achieved? This is a problem that still awaits an elegant 
solution. Consider the anchoring heuristic. Kahneman, Tversky, and the 
investigators they inspired, offer no normative model of adjustment. The 
error arising from the use of this heuristic is seen in the post-adjustment dif¬ 
ference in the estimates made by those starting with a high anchor and those 
starting with a low one. Even if this difference were closed, the result might 
be wildly inaccurate (Krueger, Freestone, & Maclnnis, 2013). 
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This limitation highlights a shortcoming of the dual-systems approach, 
namely the lack of an explicit decision-theoretic framework. There is a 
built-in neglect of false-negative errors as no provision is made for cases 
in which people would have fared better had they used an intuition-based 
heuristic (Fiedler, Kutzner, & Krueger, 2012). Research in the fast-and- 
ffugal-heuristics framework addresses this issue by abandoning the intuition- 
plus-correction template (Gigerenzer & Gaissmaier, 2011). This framework 
asks questions of ecological validity to distinguish the conditions under 
which intuitive responses work well from the conditions under which they 
do not. From this perspective, there is no generic issue of gullibility; instead 
there is a readiness to believe that may be modulated by contextual condi¬ 
tions, with positive or negative consequences depending respectively on 
the match or the mismatch of the person’s psychological capacities with 
environmental structure. 

Both, the heuristics-and-biases approach and the fast-and-frugal-heuristics 
approach leave important questions unanswered. Whereas the former 
often fails to advise human judges just how much to correct their intuitions, 
the latter offers little assistance in how to choose the best heuristic in a given 
setting (Rieskamp & Otto, 2006). The human judge has two options, which 
have only begun to receive research attention. The first option is to turn to 
processes that stimulate creativity when formal models are mute on how to 
go beyond the focal stimulus. Turning to a mindset of foraging, the judge 
can open up associate networks (Baror & Bar, 2016; Colzato, Ozturk, & 
Hommel, 2012). This tactic may not be sufficient to restore rationality, but 
it can help prepare the ground. Mental foraging has the potential to dilute or 
transform claims that might otherwise gull the person. The second option is 
to strategically choose ignorance over information, when there is reason to 
believe that the information is tainted or gulling (Flertwig & Engel, 2016). 
Homo ignorans cannot be Homo credulans. Aischylos (2014), the greatest tra¬ 
gedian of the Western canon, dramatized the value of not knowing (e.g., 
the time and circumstances of one’s death) in Prometheus Bound. Perhaps for 
us humans, blind hope beats foreknowledge at least some of the time. 

A core assumption of belief-correction models is that the person must 
want to correct the biasing effect of the focal stimulus (Evans & Stanovich, 
2013; but see Krueger, 2012b; Kruglanski, 2013). Sometimes, people 
just don’t want to. Times of distress, uncertainty, and despair are fertile 
ground for the unchecked growth of belief and superstition (Keinan, 2002). 
Practices of questionable scientific credibility enjoy popularity when other 
options have been exhausted (e.g., homeopathy, dowsing, use of charms. 
Practitioners and their clients alike use the heuristic "It can’t hurt,” and 
shift the burden of proof to the skeptics (Vyse, 1997/2014). Practitioners 
can become self-gullers, gathering enough positive evidence to convince 
themselves that the practice works (Flyman, 1981). Focusing on the co¬ 
occurrences of the focal stimulus (“the practice”) and a desired outcome 
(“success”), pseudo-contingencies (Fiedler et al., 2009; see Fiedler, Chapter 7 
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this volume) and illusory correlations (Dawes, 1989) take in the unwary. 
Self-gulling becomes a case of self-enhancement and overconfidence (Heck 
& Krueger, 2015; Moore & Healy, 2008; see also see Dunning, Chapter 
12 this volume; Macrae, Olivier, Falben, & Golubickis, Chapter 11 this 
volume). 

The Return of the Prior Belief 

From a Bayesian perspective, the power of the focal stimulus over the belief 
du jour shows the power of diagnostic or pseudo-diagnostic information 
over judgment, to the neglect and detriment of prior belief. Tversky and 
Kahneman (1974) famously asserted that focalism is so strong that it cannot 
be understood as a poor form of Bayesian thinking but that it is something 
entirely different. Humans are utterly blind, or at least myopic in some of 
their judgments (see Fiedler, Chapter 8 this volume). Yet, closing the book 
on reasoning would itself be an example of focalism. There is more. 

The idea of gullibility as a losing battle against the focal stimulus misses 
an important psychological point. It is not the case that people believe eve¬ 
rything and anything at any time. Gullibility can be highly conditional. 
Some people categorize claims into the credible and the incredible a priori. 
Consider popular conspiracy theories. There are a number of ways in which 
such theories can be developed and maintained (see Douglas, Sutton, & 
Cichocka, Chapter 4 this volume). The simplest heuristic is to divide claims 
into two categories: conventional and subversive. A person applying this dis¬ 
tinction may believe any claim falling in the latter class and reject all others. 
Epistemology, evidence, and truth aside, this tactic can yield motivational 
benefits. Subscribers may feel “clued in,” privileged, and being members of 
a select few who have peered behind the veil (Krueger, 2010). An accept¬ 
ance of all breaks with convention can lead to grotesque contradictions. 
With this strategy, reports of moon landings will be considered fake, while 
reports of aliens brought to earth by Apollo 20 (twenty!) ring true (see 
also Myers, Chapter 5 this volume). More poignandy, a person with this 
contrarian mindset may claim that climate change is a hoax, while believ¬ 
ing that the government manipulates the weather to subdue the population 
(Lewandowsky, Oberauer, & Gignac, 2013). The common denominator 
is the idea that the government and traditional news outlets lie by default 
(Pennycook, Cannon, & Rand, 2017). Ironically, conspiracy theorists of 
this type can cultivate a self-image of ingullibility. They come to believe 
that it is the ordinary people who live behind a veil of ignorance and decep¬ 
tion because of their gullibility. Again, gullibility begets self-enhancement. 
A conspiracy theorist may see no contradiction in the belief that the govern¬ 
ment practices mind control, but that his or her own mind has not thus been 
controlled (van Prooijen, Chapter 17 this volume). 

An extreme variant of conditional gullibility is “gaslighting,” further 
amplified in self-gaslighting. To gaslight someone is to insist on a falsehood 
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with such conviction that the victim begins to doubt his or her own sanity 
(Abramson, 2014). Some claims of miracles my require gaslighting (Mayo, 
Chapter 8 this volume). A communicator may boldly claim that Nelson 
Mandela died in prison until some listeners begin to consider this as a possi¬ 
bility, if only in a parallel universe (Krueger, 2016). Church father Tertullian 
raised gaslighting to a principle of religious belief when declaring “credo quia 
absurdum” (“I believe it because it is absurd”) (Biihler, 2008). Variants of 
gaslighting can be observed on the political scene on a daily basis (“The 
crowd at my rally was the largest ever!”). 

A more sophisticated tactic points to a higher order or deeper logic of 
things, which only the discerning few can appreciate. In esoteric circles, the 
cliches that “the universe does not make mistakes,” that there is a “cosmic 
balance” to things, or that “everything happens for a reason” have great 
power to gull the mind and fill it with nonsense (Ayer, 1936). Instead of 
setting up conditions for disbelief, this heuristic “liberates” the person from 
such conditions if they were suggested. Consider the case of Robert Betz, 
a self-help promoter and impresario. In a workshop JIK attended, Mr. Betz 
asserted that disease is the way of the universe to keep score (Krueger, 
2008). Leaving open the question of whether misbehavior eventually begets 
disease, Betz claimed that disease is always caused by misbehavior. The uni¬ 
verse lets us know that this is so by making the disease representative of 
the offense. Parkinson’s disease, by this logic, both reveals and punishes the 
afflicted person’s earlier quests for control. When asked by a woman in the 
audience how he explains birth defects, Betz responded with the only argu¬ 
ment left: the baby’s misbehavior lay in a past life. When asked by JIK how 
he knew this to be so, Betz put his hand on his chest and declared that he 
knew this in his heart. Belief had become untethered from reality. No other 
challenges were made. 

While Mr. Betz holds a master’s degree in marketing, Professor Justin 
Barrett has contributed to the empirical literature on child development, 
and in particular the genesis of the belief in god (Barrett, 2012). Yet, Barrett 
puts belief before reason (Krueger, 2011a, 2012a). His proof of the existence 
of god goes like this: “If god exists, we may assume that He created man 
in such a way that man is prepared to believe in god. Now that I believe 
in god, I conclude that god exists.” This is a case of the reverse-inference 
fallacy (Krueger, 2017). Barrett’s argument uses its conclusion as evidence 
for its own truth. 

Gullibility, in this world, is self-sustaining. Illogic and irrationality pro¬ 
vide multiple psychological tools, but the greater context is social. False and 
destructive beliefs survive in part when the public, even if enlightened, is 
excessively polite. It is generally difficult to challenge bad ideas, especially 
in public (Asch, 1956; Krueger & Massey, 2009). Conformity and acquies¬ 
cence are powerful forces, evolved to support social cohesion and peace. To 
confront lies, deception, and bad ideas, and do so assertively, requires skill 
and strength of mind (see von Horvath, 1937/2015, for a literary treatment 
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of this issue). Professional gullers know what they can get away with, and it 
tends to be a lot. One particularly potent device is to tap an audience’s affect 
by linking a (false) claims to core values. Core values stir the emotions much 
like sacred possessions do (Tedock, 2003), and it is a crude breach of social 
convention to question them. In an atmosphere, in which appeals to tribal 
values, mythic group identities, or other divisive themes are commonplace, 
genteel acquiescence is the handmaiden of propaganda with deleterious 
consequences for larger human society (Bemays, 1928). In the face of false 
or exploitative claims, resistance is needed, not acquiescence. 

As an example of personal failure in this regard, consider another visita¬ 
tion of the conspiracy scene (Krueger, 2015a, 2015b). In this instance, JIK 
attended a “congress” of Russian “scientists” billed as “mindfully into the 
future.” One of the presenters, a certain Professor Sergej Sail, asked who 
benefits from the antagonism between the Western and the Islamic worlds. 
The answer would appear to be obvious to those with an adequately pre¬ 
pared mind, but Sail added, for good measure, an oracular sign right out of 
the heuristics-and-biases toolbox. Hidden truths reveal themselves in surface 
similarities. Hence, Sail presented the claim — without commentary — that 
ISIS is an acronym for “Israel Secret Intelligence Service.” The skeptical 
and rational mind might wonder why, if this service were so secret, would it 
leave such an obvious hint. There was no open resistance from the audience 
(including JIK), only polite applause (not from JIK). 

Evidence Checked 

“Evidence checked” is a double entendre. When presented with wild 
claims, people can check the relevant evidence to regulate their beliefs, 
or they can “check” the evidence as they might check (i.e., resist) an ene¬ 
my’s advance. At one pole of this continuum, the pure form of enlighten¬ 
ment thinking demands the admittance and fair evaluation of all relevant 
evidence, and a principled updating of one’s beliefs, perhaps in Bayesian 
fashion. At the other pole, there is outright neglect or rejection of the evi¬ 
dence, as described in the previous section. Most human psychology plays 
out in the middle ground where evidence is entertained, but selectively so. 

Beginning with Festinger’s (1957) theory of cognitive dissonance, the 
strategic selectivity of the social mind has been a stock presence in research 
on attitudes and attitude change as well as judgment and decision-making 
more general (Cooper & Avery, Chapter 16 this volume; Fischer, 2011; 
Frey, 1986). Whether this selective sampling of information (Fiedler & 
Juslin, 2006; Fiedler, Chapter 7 this volume) and its biased assimilation 
(Ditto, Scepansky, Munro, Apanovitch, & Lockhart, 1998; Lord, Ross, & 
Lepper, 1979) is motivated or a built-in feature of the cognitive process is 
not of concern here. Rather, we note that selective processing provides a 
self-reinforcing set of mechanisms that have the potential of locking in false 
beliefs originating from focal stimuli. In other words, selective processing 
exacerbates gullibility (Myers, Chapter 5 this volume). 
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Traditionally, social psychology has been concerned with the effects of 
(potentially insincere) individual communicators (Cialdini, 2016) or the 
effects of institutionalized propaganda (Lewandowsky, Stritzke, Freund, 
Oberauer, & Krueger, 2013). In today’s digital world, social media play 
a big role in shaping beliefs on just about any topic. Here, both the indi¬ 
vidual’s biased choices and the platform’s tailored algorithms converge 
on highly selective exposure to news and stories (Bakshy, Messing, & 
Adamic, 2015). Users find themselves in “echo chambers” and “filter 
bubbles” that amplify rather than test or modulate initial beliefs. Lack 
of awareness of this skew, besides a lack of will or capacity to correct it, 
raises concerns about gullibility to a higher level (Knobloch-Westerwick, 
Mothes, & Polavin, 2017). 

Susceptibility to “fake news” has become the postmodern face of gul¬ 
libility par excellence. Defined as news items that are “intentionally and 
verifiably false” (Allcott & Gentzkow, 2017, p. 4), or that “contradict the 
best available evidence” (Flynn, Nyhan, & Reifler, 2017, p. 2), the term 
fake news has been popularized by politicians who themselves hold dubi¬ 
ous records of truthfulness. Because of its pervasiveness and resistance to 
correction, fake news compromises a democracy’s functioning (Pennycook 
et al., 2017). Fake news contaminates public discourse on the economy 
(Bartels, 2002), foreign policy (Kull, Ramsay, & Lewis, 2003), gun con¬ 
trol (Aronow & Miller, 2016), climate change (McCright & Dunlap, 
2011), vaccination (Freed, Clark, Butchart, Singer, & Davis, 2010), and 
genetically modified food (Gaskell et al., 2004). At a time when anything 
presented or represented on the Internet qualifies as “information,” psy¬ 
chological limitations to the person’s ability or willingness to correct false 
beliefs is not the only or even the central concern. Even an educated and 
willing mind is easily gulled because it does not even know which items 
require correction or dismissal. “Bullshit,” to use Harry Frankfurt’s (2005) 
technical term, is as hard to detect as it is to correct. Contemporary soci¬ 
ety is called upon to find new ways of creating and maintaining trusted 
authorities for the dissemination of credible and evidence-based informa¬ 
tion in the public interest. 

Gullibility Without a Guller: The Case of 
Irrational Trust 

It is hard to imagine gullibility without someone who is doing the gulling. 
The Hebrew creation myth features a serpentine guller praying on human 
vanity, thereby introducing gullibility as part of the original sin. Yet, we 
have seen examples of self-gulling (see also Dunning, Chapter 12 this vol¬ 
ume), and we have argued that a wholesale condemnation of susceptibility 
to social influence is not the answer. Humans need to rely on the testimony 
of others to some extent; excessive cynicism is not effective (Gaertig & 
Simmons, 2018), nor is it the case that cynical individuals are generally 
more intelligent than others (Stavrova & Ehlebracht, 2018). Like gullibility 
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more generally, interpersonal trust presents a dilemma. Without trust, life is 
poor; with excessive trust, it might be a disaster (Krueger & Evans, 2013). 
Collectively, humans flourish if they trust one another (Johnson & Mislin, 
2011), but those who are being trusted have an incentive to defect, espe¬ 
cially if the interaction is short-lived. 

In the experimental trust game, the issue of gullibility manifests as naiv- 
ite (Evans & Krueger, 2009). The game does not require a gulling agent. 
Players decide if they wish to transfer money to another person, know¬ 
ing that the transfer creates value (typically, the transferred amount is tri¬ 
pled), and knowing that the other person may not reward by keeping all 
the money (see Figure 6.2 for a display of the extensive form of the game). 
If the problem of gullibility is that people believe too much, the problem 
of naivite is that people trust too much. Conventional game theory asserts 
that any act of trust is irrational because the trustee has no real (i.e., material) 
incentive to give back. This understanding of rational choice is too restric¬ 
tive, however. The break-even point is a more realistic criterion. If people 
invest more than they receive back, their trust seems exaggerated. 

Some have argued that trust is inflated because people perceive and enact 
it as a default of cooperation (Dunning, Anderson, Schlosser, Ehlebracht, & 
Fetchenhauer, 2014; Rand, 2016). They think it is the socially correct thing 
to do, and pay the price in lost returns (Krueger, Massey, & DiDonato, 
2008). On this view, trusting is a social norm, on a par with the norm of 
reciprocity (Gouldner, 1960). This hypothesis is only partly valid. People are 



2,2 0,4 

Reciprocity Betrayal 


Figure 6.2 The trust game in its extensive form. Higher numbers indicate more 

preferred outcomes. In this depiction, the entrusted amount is quadrupled. 
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willing to punish those who fail to reciprocate trust, but refuse to punish 
those who fail to trust in the first place (Bicchieri, Xiao, & Muldoon, 2011). 
It is indeed implausible that parents and padres enjoin their charges to trust 
blindly. They rather seek to instill awareness that trust is a dilemma that can 
only be mitigated by figuring out who and when to trust. Individuals who 
have this kind of discriminative ability are perceived not only as competent 
but also as moral (Evans & van de Calseyde, 2018). 

The trust dilemma is hard, yet people have some success solving it 
(Evans & Krueger, 2016). Although they are sensitive to their own poten¬ 
tial gains and losses, people do not pay much attention to the other person’s 
(the trustee’s) incentives. These incentives predict behavioral trustworthi¬ 
ness well, but those who trust - or decide not to - neglect this source of 
information. As a result, their decisions are insufficiently regressive. Both, 
strong trust and strong distrust, should be tempered (Evans & Krueger, 
2017). People are not only too impressed by their own potential pay¬ 
offs as focal stimuli (Evans & Krueger, 2011), they also rely too much 
on the physical attractiveness of others when deciding whether to trust 
(Bonnefon, Hopfensitz, & De Neys, 2013; Olivola, Funk, & Todorov, 
2014). Instead of being a generic default, trust is cue-dependent; and some 
of the cues are bad. But people learn. Trust decisions mature during child¬ 
hood (Evans, Athenstaedt, & Krueger, 2013) and they are correlated with 
intelligence and reflective reasoning (Corgnet, Espin, Hernan-Gonzalez, 
Kujal, & Rassenti, 2016). 

Outlook 

We have considered elements of a credible theory of gullibility without 
fully developing such a theory. The challenges to such an endeavor are 
considerable. To be unique, a credible theory of gullibility would have to 
treat gullibility as a psychological phenomenon that cannot be reduced to 
general principles of learning, persuasion, and belief change. Such a theory 
would have to ensure that usage of the term gullibility is not judgmental, 
moralistic, or subject to outcome bias (Baron & Hershey, 1988; Heck & 
Krueger, 2016). We submit that a fruitful way of theorizing about gul¬ 
libility is within the context of broader perspectives on inductive reason¬ 
ing (Humean, Bayesian, Pascalian, as well as dual-processes approaches). 
Another theoretical challenge is to account for special cases of self-gulling or 
of being gulled in the absence of communication. We considered the phe¬ 
nomenon of irrational trust to explore the border region between gullibility 
proper and a related but overlapping concept. 

Notes 

1 The quote may be found here: www.washingtonexaminer.com/news/george-w- 
bush-flubs-winston-churchill-quote. 

2 Experimental social psychology traditionally relies on deception, and thus on par¬ 
ticipants’ gullibility. 
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Introduction 

For more than half a century, psychological research has been concerned 
with unwanted consequences and serious costs of irrational judgments and 
decisions. This provocative research topic emerged in the late 1960s and in 
the early 1970s, shordy after a rationalist view on Homo sapiens had been 
established in developmental research (Piaget, 1950), reasoning (Sarbin, 
Taft, & Bailey, 1960), and in the social psychology of attribution (Jones & 
McGillis, 1976; Kelley, 1967). This rationalist picture of the human mind 
had to be drastically revised in the light of growing evidence for irrationality: 
Wason’s (1968) seminal studies on the inability to solve even the simplest 
logical reasoning problems; Goldberg’s (1968, 1970) disarming demonstra¬ 
tions of shortcomings in expert judgments; Oskamp’s (1965) early work on 
overconfidence; Dawes, Faust, and Meehl’s (1989) provocative comparison 
of clinical and actuarial judgments; and of course Tversky and Kahneman’s 
(1974) groundbreaking work on heuristics and biases. From a social psycho¬ 
logical viewpoint, the list can be supplemented withjanis’ (1972) group- 
think analysis of insufficient political decision making, Weinstein’s (1980) 
notion of unrealistic optimisms, sunk-cost (Arkes & Blumer, 1985), the 
planning fallacy (Buehler, Griffin, & Ross, 1994), and the persistence of the 
fundamental attribution bias (Jones & Flarris, 1967). 

All these massive violations of rational principles were not just observed 
in artificial experimental settings but also in the context of highly conse¬ 
quential and existential problems, such as estimations of lethal risks, trust in 
expert advice, attribution of responsibility and guilt, and political decisions. 
Perhaps the most scaring conclusion from countless studies is that strong 
motivation, incentives, and careful debriefing hardly eliminate the deficits 
in human reasoning. 

Gullibility and the Attribution of Responsibility for 
Irrational Behavior 

Admittedly, this somewhat pessimistic sketch may be not quite representative 
of the recent literature, which underwent a shift from irrationality to 
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adaptive functions of ecological and social rationality (Gigerenzer, 2000). 
Fast and frugal heuristics (Gigerenzer & Todd, 1999) may not accord to for¬ 
mal logic but nevertheless help the individual to get around in an uncertain 
world. Preference reversals and fallacies (like the conjunction fallacy) may 
reflect pragmatic misunderstandings of the probability concept (McKenzie 
& Nelson, 2003). Unrealistic optimism may be justified under specific 
conditions (Harris & Hahn, 2011). Logical reasoning seems to be intact 
when reasoning tasks are framed as social contracts (Cosmides & Tooby, 
1992). Human perception is remarkably consistent with Bayesian calculus 
(Trommershauser, Maloney, & Landy, 2008; see also Krueger, Vogrincic- 
Haselbacher, & Evans, Chatper 6 this volume). And, anomalies can be con¬ 
ceived as fully normal side effects of seemingly mild and realistic constraints 
or bounded rationality (Simon, 1982). No one would contest that working 
memory is limited, that people are sometimes under-motivated, that infor¬ 
mation costs may exceed benefits from accuracy, and that optimistic biases 
can increase self-worth and happiness - but nobody would take this as a 
dramatic deficit of the mind. 

This perspectival shift in the psychology of judgment and decision mak¬ 
ing can be characterized as a shift from irrationality to gullibility (Greenspan, 
2009; Rotter, 1980; Yamagishi, Kikuchi, & Kosugi, 1999) - the focus of the 
present volume. Gullibility is an ambivalent concept that allows for differ¬ 
ent attributions of malfunctioning and failure. Is the individual too simple- 
minded and naive to solve intricate problems that exceed the individual’s 
evolved capacities? Does the mobilization of existing capacities depend on 
incentive structures and opportunity costs? Do apparent violations of nor¬ 
mative rules serve some useful adaptive function? Or does failure originate 
in careless mistakes and negligence of available knowledge for which the 
individual can be blamed? The notion of gullibility may suggest innocence 
or blameworthiness, excessive demands or carelessness, external or internal 
attributions. 

While much recent research emphasizes the individual’s “innocence,” 
suggesting external attributions for mistakes and biases to wicked environ¬ 
ments, a different perspective is taken in the present chapter. Although illu¬ 
sions and biases can originate in the environment and seemingly irrational 
behaviors may serve an adaptive function (Pleskac & Hertwig, 2014; see also 
Baumeister, Maxwell, Thomas, & Vohs, Chapter 2 this volume; Unkelbach 
& Koch, Chapter 3 this volume), this should not be misunderstood as a 
generalized acquittal. Serious attempts and progress in understanding the 
biological origins and the adaptive value of bounded rationality should not 
prevent us from noting clearly irrational behaviors such as absurd beliefs 
about death panels (Nyhan, 2010), grossly biased risk estimates (Swets, 
Dawes & Monahan, 2000), or catastrophic losses in sunk-cost situations 
(Arkes & Blumer, 1985). Allusions to bounded rationality can hardly undo 
the cost and hardship caused by such misdeeds, for which a mature social 
agent must be blamed (see Dunning, Chapter 12 this volume). 
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Metacognition Highlights the Individual’s 
Responsibility 

Individuals are particularly responsible for those quality control functions 
of their own cognitive processes that are commonly called metacognition. 
Metacognition is all about monitoring and control. Monitoring functions 
are concerned with the assessment of information validity and permissibil¬ 
ity of cognitive operations. The monitoring results then provide the input 
for control functions: basing action on valid information and discarding or 
correcting for invalid evidence. The remainder of this chapter is concerned 
with metacognitive myopia — a major source of irrationality that originates 
in conspicuous deficits in both monitoring and control functions. 

Metacognitive Myopia: Major Impediment of Rationality 

A growing body of evidence on metacognitive myopia (MM), as reviewed 
in Fiedler (2012), suggests that many reasoning deficits arise at the metacog¬ 
nitive level — reflecting failures to monitor and control for the validity of the 
information given, rather than at the primary cognitive level of perception, 
encoding, and memory functions. People are remarkably accurate in pro¬ 
cessing even complex arrays of stimulus information, and there is no cogent 
evidence for restricted capacity or motivational biases as causes of strong 
violations of logical rules. Most striking anomalies arise in spite of sufficient 
capacity and mastery of logical rules because people are notoriously uncriti¬ 
cal and naive regarding the validity of the information given. This short¬ 
sightedness (myopia) is not due to people’s lack of interest or insensitivity 
to information but, ironically, to their being too sensitive to information, 
which is taken for granted when it can be suspected to be invalid and even 
when its invalidity is obvious. 

MM at Varying Degrees of Blatancy 

Experimental evidence for MM can be organized on a continuum of task 
intricacy. On one end of this continuum are highly intricate tasks that ren¬ 
der MM effects unsurprising, making validity hard to evaluate. For instance, 
when observing small and large samples of behaviors (exhibited by in-groups 
and out-groups, respectively) laypeople will hardly take the reduced vari¬ 
ance of smaller samples into account (Linville, Fischer, & Salovey, 1989). 
Consequendy, observers can hardly correct for an out-group-homogeneity 
bias (Ostrom & Sedikides, 1992), that is, for the stereotypical tendency to per¬ 
ceive out-groups as more homogenous and less differentiated than in-groups. 

At the other end of the continuum, the naive reliance on given evidence 
(hearsay, social media tweet, gossip, advertising, others’ opinions) is most 
conspicuous if the invalidity or deceptive nature of stimulus input is crystal 
clear. For instance, even when an explicit debriefing instruction tells people 
that a statement is wrong, or when people themselves correcdy deny the 
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validity of propositions and correcdy recognize the input to be wrong, they 
nevertheless continue to be influenced by such misinformation. 


Some Provocative Evidence to Start With 

Let us first illustrate the MM syndrome with some examples from social 
psychology, which illustrate the latter type of blatant MM effects. In a later 
section, we will turn to other evidence from experimental cognitive psy¬ 
chology, which is better suited to explain the psychological origins of the 
metacognitive deficit. 

One striking example, to start with, can be found in Jones and Harris’ 
(1967) seminal demonstration of correspondence bias. Participants were 
asked to infer an essay writer’s political orientation from an essay that was 
either in favor of or against the communist spirit of the Cuban leader 
Fidel Castro. Communist attitudes were inferred from pro-Castro essays 
and anti-communist attitudes from anti-Castro essays, even when partici¬ 
pants knew that essay writers were not free to express their true opinion 
but were randomly assigned to either the pro- or to the anti-condition. 
They continued to exhibit correspondent inferences (of attitudes from 
essay contents) even though essays were written on demand and hence 
fully undiagnostic. 

In Jones and Harris’ (1967) paradigm, invalidity is obvious but it remains 
implicit. In a perseverance paradigm (Ross, Lepper, & Hubbard, 1975), 
participants are explicitly debriefed of the invalidity of an alleged feedback 
about their test performance. Nevertheless, the perseverance effect shows 
that the influence of such clearly discredited fake information is not fully 
reversible (see also Cooper & Avery, Chapter 16 this volume; Douglas, 
Sutton, & Cichocka, Chapter 4 this volume; Myers, Chapter 5 this volume). 

In two experiments by Fiedler, Annbruster, Nickel, Walther, and 
Asbeck (1996), participants who had watched a video clip of a talk show 
first responded to a series of questions asking either whether the protagonist 
had shown positive behaviors (Did he praise others? Did he delight others?) 
or whether he had shown negative behaviors (Did he neglect others? Did 
he attack others?), depending on the experimental condition. Even when 
participants correctly denied having seen these behaviors that were actually 
not presented in the film, their subsequent trait ratings were systematically 
biased towards the misleading and correcdy denied question contents. For 
instance, denying “attacking” led to higher ratings of “aggressive.” Thus, 
participants continued to rely on information that they had themselves cor¬ 
rectly classified as false. 

Decades later than Ross et al.’s (1975) intriguing perseverance effects, 
a modem research program on debunking conveys more or less the same 
message about the inability to correct for misinformation (Chan, Jones, 
Hall Jamieson, & Albarracin, 2017; Lewandowsky, Ecker, Seifert, Schwarz, 
& Cook, 2012). Meta-analyses provide strong evidence for the persistence, 
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despite convincing counterevidence, of erroneous beliefs in such myths as 
genetically modified mosquitoes causing the outbreak of the Zika virus in 
Brazil (Schipani, 2016), the existence of mass destruction weapons in Iraq 
before the U.S. invasion (Newport, 2013), or the alleged causal impact 
of the rubella vaccine on autism, measles, and mumps. The effect size of 
perseverance effects proved remarkable (d ranging from 0.75 to 1.06; see 
Chan et al. (2017). 

In all these articles, the idea of MM was never mentioned. This con¬ 
spicuous lack of interest in metacognition might itself be interpreted as a 
reflection of MM among scientists (see also Jussim, Stevens, Honeycutt, 
Anglin, & Fox, Chapter 15 this volume). Apparently, the need to criti¬ 
cally monitor and control the validity of information is hardly appreci¬ 
ated as a central module of adaptive behavior. In social cognition as in 
behavioral decision research, the individual is conceived as an agent who 
processes the given stimulus data, not as a critically minded, emancipated 
censor who decides what information to use or to discard. Chan et al.’s 
(2017) meta-analysis refers to additional stimulus input as a remedy, rather 
than to metacognitive reflection of the original input: “A detailed debunk¬ 
ing message correlated positively with the debunking effect. Surprisingly, 
however, a detailed debunking message also correlated positively with the 
misinformation-persistence effect” (p. 1531). 


Understanding the Origins of MM 

Maybe the aforementioned social-psychological studies are too com¬ 
plex and value-laden to trigger proper metacognitive reasoning. Even 
pre-assigned essays may be diagnostic about true attitude if a social norm 
obliges essay writers to be authentic. Indeed, while some norm, heuris¬ 
tic, or motive can be found to justify almost every biased inference, such 
rationalizing explanations are incomplete. A complete theoretical account 
must also explain why an upcoming bias is not detected by the monitor¬ 
ing function and why it is not corrected by the control function. The 
failure to go beyond the mere emergence of heuristic-and-bias phenom¬ 
ena and to explain why arising biases are not detected and corrected at 
the metacognitive level is typical of four decades of heuristics-and-biases 
research (Tversky & Kahneman, 1974). Virtually all research is confined 
to anchoring, availability effects, base-rate neglect, or insensitivity to sam¬ 
ple size (Tversky & Kahneman, 1971) as causes of initial biases. Hardly 
any research has ever tried to explain why Homo sapiens do not detect and 
correct for upcoming biases. 

In the subsections to follow, I will discuss five distinct subtypes of MM, 
each of which constitutes a challenging psychological research program in 
its own right. In the final section, I will summarize the evidence and discuss 
the implications of MM research for the gullibility debate and for the attri¬ 
bution of responsibility in the domain of rationality. 
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Inability Not to Learn 

A basic insight from a century of experimental psychology is that learning 
curves have positive slopes; learning strength increases with increasing num¬ 
ber of trials. In an animal conditioning context, the more often a neutral 
conditional stimulus (1,000 Hertz tone) is paired with the presentation of 
an unconditional stimulus (food), the stronger will be the conditioned reac¬ 
tion (saliva production elicited by the tone). In foreign language acquisi¬ 
tion, vocabulary learning increases with repeated rehearsal. The same holds 
for training in sports, singing, and handcraft. That learning increases with 
repeated practice is not only obvious; it is inevitable. It is easy to see that 
we cannot tell our autonomous nervous system not to learn from repeated 
pairings of signals and electrical shocks. We can also not tell our memory 
system to stop profiting from repetition. What is experienced many times 
will be increasingly kept in memory. As obvious as this truism might appear, 
this commonsense insight is systematically neglected in task settings that call 
for the exclusion of merely repeated, redundant stimuli. 

Participants in a series of experiments by Unkelbach, Fiedler, and Freytag 
(2007) saw on each trial of a computerized task a simulated TV program, 
which informed them in a running text line about the stocks that were the 
daily winners on the stock market. After 16 simulated days, their task was to 
estimate the frequency with which each stock was among the daily winners. 
The actual winning rates for subsets of stocks were 4, 6, or 8, respectively. 
However, on some days they saw two perfecdy redundant TV programs 
about the same day on the stock market, so that the presentation frequencies 
could diverge from the actual winning frequencies. For instance, given an 
actual winning frequency of 8, the presentation frequency for a given stock 
could be 8, 12, or 16, respectively, depending on how often these winning 
outcomes were repeated. Although judgments were generally quite sensi¬ 
tive to the true winning rates, the judges were strongly misled by the selec¬ 
tive repetition manipulation. Repetitions had a similarly strong influence on 
frequency estimates and preferences for the ten stocks as independent win¬ 
ning outcomes. This finding persisted after an explicit warning that some of 
the stock market news would be repeated and that selective repetition may 
distort frequency estimates. 

Given this warning, participants might have closed their eyes during 
repeated news programs, or they might have monitored and assessed what 
shares profited most from selective repetition. However, they were appar¬ 
ently not interested in monitoring and correcting for unwarranted repeti¬ 
tion biases. They presumably did not expect repetitions to influence their 
frequency estimates. By the way, the same biases were not just evident in 
numerical frequency estimates but also in ratings of the willingness to invest 
in the various shares. 

Apparendy, the underlying learning process is sensitive to every stimulus 
item presenting a share as a daily winner, regardless of whether the stimulus 
represents a new winner or a repetition of an already noted winner. Just as 
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in Pavlovian conditioning the impact of an electrical shock is quite inde¬ 
pendent of whether a shock was intentional, or planned by design, all obser¬ 
vations that link specific shares to winning support the evaluative-learning 
process. In other words, evaluative learning reflects the accrual of evaluative 
experience rather than a frequentist inference. 

Detecting Proportional Changes 

Support for this contention, and further evidence on why we cannot not 
learn from mere repetition, comes from recent evidence on the detection 
of proportional change (Fiedler et al., 2016). Assessing the proportion of a 
focal outcome is of eminent importance in reality: Is there a change in a 
student’s rate of correct responses, in a football team’s record of successfi.il 
matches, or in the acceptance rate of a political party? To investigate perfor¬ 
mance on such tasks, Fiedler et al. (2016) developed a sequential paradigm 
in which each trial provides participants with a binary sample of two sym¬ 
bols (* and o). They were asked to decide whether the current sample was 
drawn from the same universe as the preceding sample or from a different 
universe in which the probability p(*) of a focal symbol * had increased 
or decreased. Again, change judgments were sensitive to actual changes. 
However, despite this general sensitivity to p-changes, change judgments 
were strongly influenced by changes in absolute sample size n. Increases 
in relative p were readily detected when absolute n increased as well, for 
instance, when 4* out of 8 increased to 10* out of 16. However the same 
proportional change from 8* out of 16 to 5* out of 8 was hardly recog¬ 
nized. Conversely, decreases in p were only noticed readily when n also 
decreased but not when absolute sample size increased. When p remained 
unchanged (i.e., successive samples were drawn from the same universe), 
increasing n misled participants to believe that p had increased and decreas¬ 
ing n led them to believe p had decreased. 

These often replicated anomalies in detection of change were not due to 
misunderstandings of task instructions. Participants did not simply count the 
cardinal number of critical * symbols in the numerator. This was evident 
from the fact that when n (i.e., the denominator) was held constant a change 
from, say, 4* out of 8 to 5* out of 8 was not different from a change from 
8* out of 16 to 10* out of 16. It is also insufficient to explain the anomalies 
as ratio bias (Denes-Raj, Epstein, & Cole, 1995) or denominator neglect 
(Reyna & Brainerd, 2008), because it was easy to keep p independent of 
n when *-proportions were described numerically, as normalized percent¬ 
age (Fiedler et al., 2016, experiment 2). The anomalies were only observed 
when proportional quantities had to be extracted inductively from experi¬ 
enced samples. 

Indeed, logical reflection shows that the inductive assessment ofp must 
be sensitive to n. Imagine a highly motivated and perfectly unbiased partici¬ 
pant who sincerely wants to assess the proportion of * symbols experienced 
in a binary sample, or else, the rate of pro arguments in a political debate, or 
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different students’ proportions of correct responses in the virtual classroom. 
In any case, the task calls for a continuous update of a sample proportion 
p* of the frequency / of focal elements divided by the total number n of 
all elements. The question, however, is what positive increment or nega¬ 
tive increment must be added to the growing sample proportion for each 
new observation of a focal or non-focal element. Logically, the incremental 
weight given to each elementary observation should be 1 In. In a very long 
list of 100 observations, each element should be given a weight of 1/100. 
But if n is only 2 or 3, the elementary observation must be given a much 
higher weight of 1/2 or 1/3, respectively. 

But what should our ideally motivated, unbiased assessor do when n is 
undefined, that is, when the overall number of political votes or student 
answers is not known beforehand? Indeed, under most natural task condi¬ 
tions sample sizes n are unknown and uncontrollable. Nobody knows in 
advance how many pro and con arguments will be produced in a politi¬ 
cal debate, how often different students in a school class raise their hands 
and provide responses to knowledge questions. Moreover, n is often fully 
undetermined; it may be impossible to say when a sample started and when 
it will end. Apart from the fact that n is unknown beforehand, it may be 
impossible to administrate the impact of all ns belonging to hundreds of 
sampling tasks in which we are involved at any point in time, recalculating 
growing ja* (after n observations) from the preceding estimate n „ t p* (after 
n—1 observations) according to the normative updating rule ja* = [(1 /n) ■ 
n th element] + [(n—l)/n • n _jp*]. As n increases, such an updating rule would 
become more and more demanding in terms of numerical precision and 
replete with cumulative error. 

Still, even though it is impossible to divide the number of focal outcomes 
by an exact count of n, our rational agent is quite sensitive to proportions, 
that is, he or she will somehow relate the number of focal outcomes (in 
the numerator) to a crude feeling (in the denominator) of n in the stimulus 
context. The same number of focal features in the current sample may thus 
be worth more (less) if a small (large) preceding sample suggests a smaller 
(larger) denominator. 

Note that such context sensitivity might actually account for the full 
pattern of anomalies reported in the preceding section. If the size of the 
former sample triggers the expectation of the (uncertain) size of the current 
sample size (denominator), then indeed the same number of * observations 
in the current sample should be worth more (less) when a small (rather than 
a large) preceding sample decreases the expected denominator and thereby 
increases the weight given to elementary * observations. 


Responsibility for Sample-Size Insensitivity 

The preceding causal explanation for the impossibility to assess proportions 
whose denominators are unknown should not be mistaken as an excuse for 
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all the massive biases we have found in detection-of-change tasks. Although 
the foregoing discussion might help to explain the origin of MM for sample 
size, it does not explain why the MM lethargy carries over to many situ¬ 
ations in which the biasing impact and unfairness of unequal n are crystal 
clear. My cognitive analysis of the impossibility of assessing p independendy 
of n is not meant as an acquittal for other, hard-to-believe consequences 
of MM for the impact of sample size. For an illustration, let us return to a 
social psychological perspective on clearly irrational and unnecessary biases 
and shortcomings for which mature human beings must be held responsible. 

One memorable example can be found in criteria based statement analy¬ 
sis (CBSA; Steller & Kohnken, 1989; Vrij & Mann, 2006), the diagnos¬ 
tic method used by expert witnesses to evaluate the credibility of witness 
reports. CBSA is typically applied in criminal (rape or sexual abuse) trials 
in which no physical evidence is available so that court decisions with exis¬ 
tential consequences for the defendant depend on the validity of the credi¬ 
bility analysis. As the presumption of innocence implies the null hypothesis 
that an aggregating witness statement is wrong, the CBSA method consists 
in a one-sided search for linguistic truth criteria in the transcribed report. 
An expert witness’ review and recommendation thus depend on how many 
truth criteria can be found in the report, such as amount of detail, sponta¬ 
neous self-correction, or structured presentation. The CBSA count of lin¬ 
guistic symptoms of veracity very often determines whether the defendant 
goes to jail, loses his family, his job, and his existence. However, although 
CBSA counts have been shown to be higher when reported experiences 
are real, they are also subject to a detrimental artifact, text length. A long 
report of 15 or 20 pages is more likely to include a reasonable number of 
truth criteria than a short report of only 2 pages. Although so much is at 
stake and the flagrant bias is easy to understand and might be corrected in 
a straightforward manner, this problem is widely ignored in legal practice 
(Fiedler, 2019). 

In a similar vein, the inability to perfectly monitor and control for n 
generalizes to many other situations, in which unfair evaluations depend 
on sample size and appropriate corrections suggest themselves: teachers’ 
evaluations of students providing unequal numbers of responses (Fiedler, 
Wollert, Tauber, & Hess, 2013), self-serving biases due to larger samples 
of self-related than other-related experience (Moore & Healy, 2008), in- 
group-serving biases, or devaluation of minorities relative to majorities 
showing identical rates of positive behavior (Fiedler, 2000a, 2000b, 2008). 
Or, for an example from the allegedly rational domain of science (seejussim 
et. al., Chapter 15 this volume), evidence for distinct hypotheses is strongly 
contaminated with the biasing impact of the popularity and the number 
of conducted studies. Validity concerns and critical assessments of whether 
manipulations have been effective or whether mediation tests are logically 
appropriate (Fiedler, Harris, & Schott, 2018) are hardly ever considered, 
reflecting a strong syndrome of MM in scientific practice. 
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Pitfalls of Conditional Reasoning 

A similar story can be told about a long tradition of research on con¬ 
ditional reasoning. To illustrate, consider the conditional probability 
p(HIV| positive test) that people have actually contracted the HIV virus 
given a positive HIV test. Estimates of this conditional are highly inflated 
if participants are told that the base rates of HIV is p(HIV) = 0.1%, that 
the base rate of positive test results is ^(positive test) = 1%, and that the 
reverse conditional, or hit rate of HIV-infected people who are tested 
positively is p (positive test|HIV) = 100%. To provide a correct estimate of 
p(HIV|positive test), Bayes’ theorem prescribes that the reverse conditional 
must be multiplied with the ratio of the two base rates: p(HIV|positive 
test) = ^(positive test|HIV) ■ p(HIV)/p(positive test) = 100% ■ 0.1%/1% 
= 10%. The conditional probability of HIV given a positive HIV test is 
indeed in the range of 10%. 

That most judges grossly overestimate this remarkably low figure is easy 
to “explain” or to justify, by simply admitting that lay people are not in 
full command of Bayesian calculus. Understanding that the ratio of two 
inverse conditional probabilities p(HIV|positive test)/p(positive test|HIV) is 
identical to the ratio p(HIV)/p(positive test) of corresponding base rates 
sounds like higher mathematics that ordinary people cannot be expected to 
understand. So nobody would come to blame ordinary people who dra¬ 
matically overestimate risks expressed as conditional probabilities. 

However, again, the strong anomalies persist under conditions that 
make it easy to recognize and overcome the underlying base-rate neglect 
(Bar-Hillel, 1984). For instance, consider an experiment (cf. Fiedler, 
Brinkmann, Betsch, & Wild, 2000) in which participants who know the 
HIV base rate is very low (say, 1 out of 1,000) are presented with an 
index-card file with two slots, one containing very few HIV cases and 
another slot with a huge number of (1,000 times more) not-HIV cases. 
Each index card has the diagnosis (HIV vs. not HIV) on one side and the 
test result (positive vs. negative) on the other side. Participants can sample 
as many cards from the file as they feel appropriate to make an accurate 
estimate of p(HIV|positive test). A typical search pattern would be that 
participants sample all (rare) HIV cases plus a similar number of not-HIV 
cases. Noting that the test result is positive for 100% of all HIV cases but 
only for very few not-HIV cases, most people infer that a positive test 
result is a very good predictor of HIV. 

The serious flaw does not lie in a failure to apply Bayesian calculus. It 
lies in the obvious fact that a sample of roughly equal numbers of HIV 
and non-HIV cases is extremely biased. While it contains all HIV cases, 
it only contains a vanishingly small subset of not-HIV cases. Basing a 
conditional estimate of HIV on such a dramatically biased sample, which 
grossly over-represents the true rate of HIV cases is reflective of an 
incredibly blatant version of MM, for which mature adult people can be 
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held responsible. It is easy to see that a raffle that selectively includes all 
unattractive items is not attractive or that a forecast of a football team’s 
winning record should not rely on a sample that draws heavily on only 
the worst matches in the past. 

Yet, as a consequence of MM, people continue to make important infer¬ 
ences from such extremely biased samples, the invalidity of which is not at 
all beyond the scope of human intelligence. When given a forced choice 
between a biased and an unbiased sample, MM often prevents Homo sapiens 
from choosing correctly. Thus, keeping with the previous example, when 
highly educated students can choose between (1) a biased sample that con¬ 
tains equal numbers of HIV and not-HIV cases and (2) an unbiased sam¬ 
ple that contains proportionally more not-HIV cases, they typically prefer 
to base their estimate on the former sample. Apparently, MM gives more 
attention to the superficial advantage of an equal-n design than to a critical 
or thoughtful check on whether the very attribute to be estimated is mis¬ 
represented in the sample. 

Impoverished Causal Reasoning 

Causal impact judgments provide another example of MM that at first sight 
appears to reflect an adaptive property of the human mind. Logically, the 
impact of a manipulated change Ax in a causal condition x on an observed 
change Ay in an effect dimension y can be quantified by a ratio Ay/Ax. 
Causal impact is highest when a minimal causal input (small denominator) 
produces a maximal effect (high numerator). For instance, if a very small 
dosage of a poison (small Ax) is sufficient to kill a huge elephant (strong 
Ay), the causal impact is higher than if the same dosage only kills a tiny 
mouse (smaller Ay), or if a much higher dosage (larger Ax) is required to 
kill an elephant. 

This ratio principle underlying the notion of causal impact — dividing the 
size of an effect by the amount of causal input that was required to produce 
the effect — appears logically sound and not too complicated for the human 
mind. It affords a plausible solution of many practical problems. Given that 
10 grams of a substance have a nutrition value of 50 calories, we can infer 
that 100 grams of the same substance have 500 calories. Or, if 5 grams of 
another substance have 50 calories, its nutrition value must be twice as 
high. Yet, actual judgments of causal influences are not sensitive to this 
obvious ratio principle. Oftentimes, judges are exclusively sensitive to effect 
sizes and largely ignore the causal input, taking the experienced effect for 
granted, while MM prevents them from deeper thinking about the causal 
story behind. We assess whether a patient’s depression is mild or severe, but 
hardly ever relate the degree of depression to the strength of the stressors in 
a patient’s life that brought about the depression. Or, in science, we praise 
studies with high effect sizes, but we hardly ever consider how strong an 
experimental manipulation was necessary to produce an effect. In empirical 
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science, we definitely do not downgrade an effect (Ay) if it was caused by 
too strong a treatment (Ax). While it is difficult to publish a study produc¬ 
ing a very weak effect, reviewers and editors will hardly ever reject a paper 
because a causal treatment was too strong. 

When causal origins cannot be fully ignored as in science, causal rea¬ 
soning does not follow the ratio principle. Rather, researchers base their 
causal-impact judgments on the covariance principle: The causal impact 
demonstrated in experiment is considered maximal if a strong cause pro¬ 
duces a strong effect (not if weak input managed to produce strong output). 
The same holds forlay judgments of causal impact (Hansen, Rim, & Fiedler, 
2013): If “45-minute waiting time causes an increase in customer anger of 
10 scale points,” the subjective causal impact is stronger than if “14-minute 
waiting time causes an increase in customer anger of 10 scale points.” 

Again, one might justify the covariance principle as an adaptive strategy 
(Fiedler, Freytag, & Unkelbach, 2011): In reality adaptive agents not only 
face the task of quantifying the impact of a single cause; they typically have to 
detect the influence of a cause in the context of many different causes a, b, c, 

. . . w that vary at the same time. When in such a multi-causal setting an effect 
Ay co-occurs with changes in several causal factors, a very subde change in, 
say, Ad, will be much less detectable than a massive change in, say, Aw. A loud 
and attention-grabbing provocation is more detectable and will thus appear 
to have a stronger causal impact on an aggressive act or crime than a hardly 
detectable, subde insulting gesture. 

Still, although covariance looks like an adaptive rule that maximizes 
detectability, it hardly justifies the maladaptive neglect of the ratio princi¬ 
ple and the widespread tendency to focus on salient effects while ignoring 
causal origins. It cannot be adaptive only to evaluate the performance of a 
car, without considering the amount of fuel required to reach that perfor¬ 
mance. Indeed, ignoring the causes of many ecological, economical, and 
political effects represents a cardinal case of MM. 


Divergent Trends at Different Aggregation Levels 

Last but not least, a prominent final example is MM for existing differences 
between aggregation levels. On one hand, the vicissitudes of aggregation 
levels are intrinsically counter-intuitive, and one is tempted to excuse their 
neglect. It is hard to understand, for instance, that the correlation between 
Black skin color and illiteracy is negligible at the level of individual people 
but close to perfect at the level of large geographic districts. Black indi¬ 
viduals are hardly more likely than White people to be illiterate, but the 
correlation between the proportion of Black people and the proportion of 
illiterates in different U.S. districts is very high (r > .80 for very large dis¬ 
tricts). This may be hard to understand at first sight. One has to recognize 
that the genetic influences underlying individuating correlations are fully 
independent of the economic factors producing the ecological correlation 
at high district level (Robinson, 1950). 
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However, on the other hand, the notion of divergent trends at varying 
aggregation levels does not exceed our intelligence; we are familiar with 
many pertinent examples. Rich nations may have high poverty rates; what 
is pleasant in the short run may be unpleasant in the long run; or research 
findings obtained at group level need not hold for individual participants. 
Because of these and many other plausible experiences, the human mind is 
not bound to myopic confusion of aggregation levels. The gender stereo¬ 
type that leadership ability is more typical of males than of females is true 
at the level of vocational environments (Eagly & Steffens, 1984). In voca¬ 
tional fields with the highest rate of leadership ability (top management in 
organizations) the rate of males is highest. Yet, at the individual level, it is 
possible that the few female leaders working in top management positions 
outperform the majority of males, thus creating an inverse correlation at 
individuating level. Regardless of whether females are actually superior or 
inferior, the point here is simply that confusing correlations observed at 
different aggregation levels is a serious category mistake. 

Conclusions: Gullibility, Myopia, and Social 
Responsibility 

Thus, a review of MM effects reveals that rationality research is intimately 
related to the ambivalent concept of gullibility, the meaning of which 
implies both innocence and negligence. A good deal of recent work on 
judgment and decision-making highlights the normal origins and the adap¬ 
tive functions served by many apparent violations of rational norms. Biases 
and illusions can be explained as normal consequences of ordinary laws of 
learning, properties of the probabilistic environment, and intrinsic difficul¬ 
ties of some inference tasks. However, even when the origins of irrational 
behavior can be understood and rationalized, this does not exempt the indi¬ 
vidual of his or her social responsibility. In spite of bounded rationality, the 
individual remains blameworthy. Not all deficits in metacognitive functions 
can be attributed to unavoidable constraints. Some MM effects are unbe¬ 
lievably blatant and naive and not enforced by task demands that exceed 
our cognitive capacities. We perfectly understand that selective repetition 
may bias impressions, that the probability that males are millionaires is much 
lower than the probability that millionaires are male, that highly concen¬ 
trated poison has more causal power than diluted poison, or that happiness 
of nations is not happiness of people. And yet, we fall prey to repetition 
biases, fail on highly meaningful conditional reasoning tasks, we misunder¬ 
stand the ratio principle of causal inference, and we are completely confused 
by divergent trends observed at different aggregation levels. 

The MM perspective on rationality points to missed opportunities to uti¬ 
lize insights and critical analyses that are easily understood and hard to contest. 
It appears as if, for some reason, we are simply not interested or motivated 
to engage in critical assessment, or to cast the validity of a flawed sample into 
question. For an illustrative example, consider the recent “me too” debate on 
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the social media, and its echo in the mass media. Regardless of what part of 
the information solicited in this public debate is true, semi-true, exaggerated, 
or even faked, and regardless of whether part of the reported transgressions 
are harmless and manifestations of normal mating behavior, the sampling 
procedure or “research design” underlying this media game is sorely biased. 
The debate relies on a retrieval prompt that exclusively refers to the worst 
exemplars of norm-violating behaviors represented in the extreme part of the 
distribution of (male) human conduct. The amount and strength of evidence 
solicited by such a sampling process do not tell us anything about the relative 
rate of such misbehaviors, because normal and nice behavior is ignored. All 
we can infer from such a lop-sided sampling process is that a large number 
of social media agents (maybe more than a billion) have been reached by 
the “me too” prompt. Although we fully understand that such a “research 
design” is biased, we nevertheless continue to be impressed by the pessimistic 
results. It is somehow comparable to persisting illusions that continue to fool 
our perception in spite of perfect debriefing. 

Nevertheless, an ultimate goal of a gullibility debate must be to counter 
this MM lethargy and to remind people of their responsibility to engage 
in critical monitoring and control. Neither restricted working memory 
nor lack of incentives nor any other aspect of bounded rationality restricts 
our ability, and our obligation to monitor and control the quality of the 
information that impinges on our mind. For some inference problems, 
to be sure, there may be no patent remedies at the metacognitive level. 
Repetition biases cannot be turned off, the base rates needed to deal with 
conditional inference problems may be unknown, and information may 
not be available at the appropriate aggregation level. Even then, however, 
we can still recognize dangerous situations in which stimulus samples are 
flawed, an information source is untrustworthy, or unequal sample size must 
lead to unfair and lop-sided comparisons. And we can decide not to act or 
to discard information that is obviously flawed. 

Recent work on nudging (Thaler & Sunstein, 2008) and prudent default 
setting (Johnson & Goldstein, 2003) emphasizes environmental design and 
external decision aids as key interventions. The MM perspective suggests an 
opposite, self-determined and internally controlled approach, namely, critical 
assessment and emancipation at the metacognitive level (Hertwig & Griine- 
Yanoff, 2017). Which of the two opposite approaches turns out to be supe¬ 
rior is a matter of future research, but for the moment, the gullibility debate 
can help to articulate the psychological underpinnings of both positions. 
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8 The Skeptical (Ungullible) 
Mindset 

Ruth Mayo 

THE HEBREW UNIVERSITY OF JERUSALEM 


Did the Americans really land on the moon? Opinion polls suggest that 
between 6% and 20% of Americans surveyed believe that the manned land¬ 
ings were faked. The claim purports that the famous moon landing was 
staged, either in Hollywood or in Area 51, with the aim of defeating the 
Russians in the space race while avoiding any risk of failure. The money for 
the moon landing was supposedly given to many people who took part in 
this scam to do their job and forever keep this a secret. Don’t believe it? Take 
a look at the famous picture of the landing. Why is the flag moving when 
we know there is no wind on the moon? Where are the stars? And why is 
there no crater where the Lunar Module has landed (https://en.wikipedia. 
org/wiki/Moon_landing_conspiracy_theories)? Reading these claims and 
looking at the picture with these questions in mind, on a scale from 0 (didn’t 
land) to 10 (definitely landed), think for a minute and note how sure are you 
that indeed the Americans landed on the moon? 

Psychology theories and research suggest that even if you were com¬ 
pletely certain that the Americans landed on the moon, now, after reading 
the above claims, you are a bit less sure, choosing 9 or 8 on the scale rather 
than 10. Why? How does reading some alternative theory, a conspiracy 
theory, affect us in the sense of considering it as a possibility? If someone 
thinks that the Americans did land on the moon, and after being exposed to 
the above conspiracy theory s/he is a bit less sure about it, then this suggests 
how gullible our mind is, being affected by any passing information even 
when we think or know this information is wrong. 

The Gullible Mind 

The advocated cognitive basis for the gullible mind is the spontaneous nature 
of belief in contrast with the secondary nature of disbelief. The basic asser¬ 
tion is that the process of understanding any information entails belief. In 
other words, understanding is believing. And while belief is the spontaneous 
primary process, negating information is a secondary process, demanding 
motivation, ability, and cognitive resources (Deutsch, Gawronski, & Strack, 
2006; Gilbert, 1991; Gilbert, Pelham, & Krull, 1988; Gilbert, Tafarodi, & 
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Figure 8.1 The Cartesian and Spinozan models. 
Source: Adapted from Gilbert (1991). 


Malone, 1993; Trope, 1986). The “understanding equals believing” model 
dates back to Spinoza and is presented in contrast to the Cartesian model (see 
Figure 8.1). While the latter suggests that people can comprehend informa¬ 
tion without tagging it as true or false, the Spinozan model theorizes that 
comprehension entails immediate acceptance that may be overturned only 
with a secondary processes of evaluation that results in the endorsement of 
the initial acceptance or a lack of acceptance. 

The most direct set of studies aiming to test the Spinozan model was 
conducted by Daniel Gilbert and colleagues (Gilbert, 1991; Gilbert et al., 
1988; Gilbert et al., 1993), who demonstrated that if participants are con¬ 
strained cognitively — for example, by having to do multiple tasks — they 
keep using in their judgments and decisions information that they know is 
false. These findings are interpreted as a demonstration of the primary belief 
model, showing that interfering with the secondary process can leave one 
holding a belief about even clearly false information. Importandy, studies 
have demonstrated that even without interference, people have a difficult 
time negating explicitly false information (Begg, Anas, & Farinacci, 1992; 
Gilbert, Krull, & Malone, 1990). For example, people do not remember 
clear negations and end up recalling as true the information that was clearly 
negated (e.g., remembering that “the side effects of the flu vaccine are more 
dangerous than the flu itself’ even though this information was explic¬ 
itly tagged as false; Schwarz, Sanna, Skumik, & Yoon, 2007). One of the 
more extreme examples of this failure of negation is the false-memory effect 
whereby events that are correcdy rejected at first become “true” memo¬ 
ries of real events (Fiedler, Walther, Armbruster, Fay, & Naumann, 1996; 
Loftus, 2005; see also Fiedler, Chapter 7 this volume; Forgas, Chapter 10 
this volume; Schwarz & Lee, Chapter 13 this volume). Thus, if you are 
asked if you saw a coat hanger in an apartment, and you didn’t, you will 
initially correctly answer “no,” but after some time has passed and you are 
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asked again, chances are significantly higher that you will think that you 
saw a coat hanger in the apartment and say “yes” compared to a situation in 
which you did not see a coat hanger and were not asked about it before. In 
other words, negating correctly in an initial instance may lead to incorrect 
affirmation at a later time (Fiedler et al., 1996). 

Other effects are endorsed as supporting the Spinozan model from the 
belief aspect; one example is the acquiescence inclination, as people tend to 
say “yes” to everything (Knowles & Condon, 1999). Again, the idea is that 
when one is asked “Were you satisfied with your first year at college?” then 
one thinks of good things that happened, things that one is satisfied with, 
and therefore respond in the affirmative; but if one is asked “Were you 
disappointed with your first year at college?” one now thinks about disap¬ 
pointing things that happened and therefore affirm again. In other words, 
we tend to affirm as we accept and think in a congruent way with whatever 
concept we are exposed to. A related phenomenon is the most basic con¬ 
firmation bias whereby people tend to search for, perceive, and interpret 
information that confirms rather than falsifies their preexisting thoughts (see 
also Dunning, Chapter 12 this volume; Snyder & Swann, 1978; Wason & 
Johnson-Laird, 1972). 

Thus, decades of research conclude that believing, affirming, and accept¬ 
ing is primary, while negating, falsifying, and rejecting is secondary. One 
must have the motivation, time, and cognitive resources in order to be able 
to negate. Comprehension means acceptance, and that is the basis for our 
gullible mind that first believes and accepts any given information and is 
able to reject only as a secondary, demanding process. If this is the case, then 
how can we explain our spontaneous, immediate rejection of certain sug¬ 
gestions, such as to click on a link that promises we will win a million-dollar 
prize? Or the offer of a ride home from a complete stranger who stopped 
his car next to us? Do we need motivation, time, and cognitive resources 
to reject the “click here,” “get in” messages? The current chapter proposes 
that the answer is “no” and aims to demonstrate that negation can also be 
(a) successful and (b) a primary process. 

The Condition for Successful Negation 

As outlined above, most research portrays negation as a secondary process 
that is prone to fail, leading to gullibility. The explanation given for this 
“weak” negation lies in the way we process and encode negation: We first 
process the core of the negated sentence and then add negation to it (Clark 
& Chase, 1972; Just & Carpenter, 1976). For example, if one is told, “Tim 
is not a tidy person,” the concept of “tidiness” is activated in one’s mind, 
together with congruent associations such as tidy behaviors (e.g., keeping a 
daily schedule) and other related traits (e.g., pedant). Only at the next stage 
does one negate the concept of tidiness by giving these activated associations 
a negation tag, and therefore one will correctly negate at that point (see also 
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Krueger, Vogrincic-Haselbacher, & Evans, Chapter 6 this volume). But, 
and this “but” is important, because the negation tag is a separate cognitive 
construct added to the core and its congruent associations, the two (i.e., 
core and negation tag) might get separated due to many reasons, including 
simply the passage of time, leaving one, in the end, falsely remembering that 
s/he was told that “Tim is a tidy person.” We termed this model of nega¬ 
tion processing and encoding the “schema-plus-tag model” (Mayo, Schul, 
& Bumstein, 2004). Important consequences of this model include immedi¬ 
ate activation of the schema associations that actually represent the opposite 
meaning of negating the statement (or other stimuli), with the end result 
that we might lose the negation tag and have only the schema remain in our 
mind, again, with the opposite meaning of the original message. One can 
easily see how the schema-plus-tag model is congruent with the Spinozan 
model — accepting a concept first and negating it later with the risk of being 
left only with the concept. The schema-plus-tag model explains why nega¬ 
tion is secondary and prone to failure. 

However, studies suggest another model by which we may process 
and encode negation (Brewer & Lichtenstein, 1975; Gannon & Ostrom, 
1996; Horn, 1989; Lea & Mulligan, 2002; Lyons, 1995; MacDonald &Just, 
1989). We term this model the “fusion model” because it fuses the core 
of the negation with its negation tag into an alternative affirmative schema 
that carries the meaning of the negation (Mayo et al., 2004). Thus for the 
statement “Tim is not a tidy person,” we activate an affirmative alternative 
schema that communicates the meaning of the negation of “tidy,” which is 
“messy.” Messy is an affirmative schema that means “not tidy.” In this case, 
the concept of “messy” is activated in one’s mind together with congru¬ 
ent associations such as messy behaviors (e.g., having piles of paper on the 
desk) and other related traits (e.g., confused). Hence, in the fusion model 
we process and encode negation within a schema that is congruent with the 
negation’s meaning, suggesting a successful negation both in the immediate 
moment as well as in memory. We will remember that Tim is messy. If the 
fusion model enables successful negation, why don’t we use it at all times? 

In order for the fusion model to be available for us to use, there must be 
an alternative affirmative schema that represents and connotes the negation 
meaning. If there is not, we are stuck with the schema-plus-tag model. Our 
work demonstrates this critical role of the alternative affirmative schema 
in an experiment using bipolar characteristics (e.g., having clear opposites, 
such as happy/sad, smart/stupid) in one condition, and unipolar characteris¬ 
tics (e.g., characteristics that don’t have a simple opposite, such as romantic, 
adventurous, and responsible) in the other condition (Mayo et al., 2004). 1 
For each characteristic we created three behavior probes: one that is con¬ 
gruent with the characteristic but not with the characteristic’s negation (i.e., 
for “Tim is tidy”: “Tim’s clothes are folded neady in his closet”); one that 
is congruent with the characteristic’s negation but not with the charac¬ 
teristic (i.e., “Tim forgets where he leaves his car keys”); and one that is 
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irrelevant to the characteristic (i.e., “Tim likes to have long conversations 
on the phone”). The participants read the description of the person and 
then received the behavioral probe and had to decide as accurately and 
quickly as possible if the behavior is congruent, incongruent, or irrelevant 
to the description read before. We measured how long it took to make 
these judgments. Each participant saw half of the descriptions appear in 
affirmation and the other half in negation, and responded to all three types 
of behaviors that appeared in a random order between blocks. The find¬ 
ings indicated that for affirmative descriptions, responses for both bipolar 
and unipolar descriptions were faster for the congruent behaviors than the 
incongruent ones, suggesting that people have in mind associations that fit 
the description and therefore are quicker to respond to congruent types 
of behaviors than incongruent ones. However, for the negated phrasing, 
given bipolar characteristics, participants were faster to respond to congru¬ 
ent than incongruent associations, while the opposite was true for unipolar- 
characteristics. For the latter, participants were actually faster to respond 
to incongruent associations than to congruent ones. Thus, while for both 
unipolar and bipolar characteristics participants correcdy negate, they think 
of the negation-congruent meaning for the negation of bipolar character¬ 
istics, and they think of the negation core meaning for the unipolar ones. 
We also tested participants’ memory of the descriptions in a surprise quiz at 
the end of the study. Memory for the affirmatively phrased descriptions was 
high for both the bipolar terms (91%) and the unipolar descriptions (93%). 
However, correct memory of the negated descriptions was much better for 
the bipolar terms (83%) compared to the unipolar terms (62%). Specifically, 
the case of losing the negation tag and remembering in error only the core 
of the message was significantly more prevalent for the unipolar descriptions 
(38%) compared to the bipolar descriptions (14%). Thus, in order to negate 
successfully, one must have an alternative affirmative schema. 

Exploring research that demonstrates the weakness and failure of nega¬ 
tion leads to the conclusion that in these studies the negation concerned a 
unipolar type of information. For example, for the false-memory phenom¬ 
enon, there is no opposite for getting lost in the mall when you were 5 years 
old — you either got lost or you didn’t. Thus, properly negating getting lost 
leads one to have an image of getting lost, and although one correcdy denies 
it, still the image and congruent associations (e.g., crying) remain, and thus 
one may lose the negation tag and succumb to false memory. This is also 
true for negating seeing a coat hanger in the apartment, or negating false 
information in general, such as circulating concepts that the MMR vaccine 
causes autism. In all of these instances, there is no an alternative affirma¬ 
tive schema, and this may be the reason for the failed negation process and 
encoding. Indeed, research now has demonstrated repeatedly that having an 
affirmative alternative schema enables a successful negation (Chiu & Egner, 
2015; Horne, Powell, Hummel, & Holyoak, 2015; Isbemer & Richter, 
2013; Orenes, Beltran, & Santamarfa, 2014; Rapp, Hinze, Slaten, & Horton, 
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2014; Richter, Schroeder, & Wohrmann, 2009; Tettamanti et al., 2008; 
Vandeberg, Eerland, & Zwaan, 2012; see also Douglas, Sutton, & Cichocka, 
Chapter 4 this volume; van Prooijen, Chapter 17 this volume, on how such 
a process might apply to conspiracy theories). It is important to note that, 
as in the study of Home et al. (2015), the alternative schema does not need 
to be a semantic construction. If one has any alternative schema that serves 
him or her for the negation, s/he will negate successfully. Specifically, Horne 
et al. (2015) offered an alternative affirmative schema for the false casualty 
posited between the MMR vaccine and autism by activating the alternative 
image of the illness that the vaccine eradicates. 

A wonderful example may be found in the study regarding the paradoxi¬ 
cal effects of thought suppression (Wegner, Schneider, Carter, & White, 
1987): “Don’t think of white bears.” Reporting this effect, all that is usually 
said is that once you are told not to think of white bears, you keep think¬ 
ing of them. However, in the same research, in the second experiment, 
Wegner et al. (1987) offered their participants an affirmative alternative 
schema: “If you do happen to think of a white bear, please try to think of a 
red Volkswagen instead.” In this experimental condition, participants were 
less likely to demonstrate the preoccupation with white bears. 

Of course, having an alternative schema doesn’t guarantee that one will 
use it. Various factors may affect whether we choose the schema-plus-tag 
model or the fusion model. For example, we found that participants who 
suffer from rumination tend to negate with a negative schema: using the 
schema-plus-tag model for negation of negative information (for “Tim is 
not stupid”) but the fusion model for negating positive information” (for 
“Tim is not smart”). This pattern suggests the possibility of the negative 
schemas being chronically activated, thus leading to their use when they are 
negated or when their affirmative counterpart is negated (Haran, Mor, & 
Mayo, 2011). Hence the schema we use may depend on who we are, what 
we are thinking about, and more. For example, before a medical procedure 
if the doctor says that the “procedure is not dangerous,” even though there 
is an alternative affirmative schema for “not dangerous” (i.e., safe), given 
that the patient is likely prone to being worried, chances are high of using 
the schema-plus-tag model and continuing to think mainly of danger. 

Interestingly, most negative behaviors don’t have an alternative affirma¬ 
tive schema — you either did them or you didn’t. Therefore, negating a 
negative behavior actually leads others to think of that negative behavior, its 
congruent associations, and probably remembering it as something you did. 
If you want to successfully negate it, you must come up with an alternative 
affirmative schema. For example, instead of saying, “I did not steal,” one 
may consider saying, “The police are trying to set me up.” Returning to the 
opening example of conspiracy theories, the interesting point is that usually 
conspiracy theories suggest claims that don’t have an alternative schema (for 
many examples in this volume, see Cooper & Avery, Chapter 16; Douglas 
et al., Chapter 4; Myers, Chapter 5; van Prooijen, Chapter 17). But if one 
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has such a schema, then s/he can negate these theories. Thus, knowing the 
explanation for the doubts raised by the picture of the moon landing will 
lead people to be less influenced by the suggestion that the Americans never- 
landed on the moon (i.e., the landing was done gradually and this is why 
there is no crater, the angle of the photo leads to not seeing the stars, and the 
movement created when putting the flag in the ground on the moon actu¬ 
ally led to its apparent fluttering, which continues even more because there 
is no atmosphere on the moon). Of course, there could be a competition 
between the negated false information and the truth. Many times the false 
information is much more interesting and vivid than the boring truth. This 
may also affect the type of negation model used and therefore its end result. 
These factors and many others should be further tested to better understand 
when and why people process and encode negation with the successful 
versus unsuccessful model. 

Negation as a Primary Process 

Accepting the two models of negation and their role in successful nega¬ 
tion still leaves the possibility that negation begins with the schema-plus-tag 
model, and if conditions are right, the fusion model is applied in a later- 
stage of processing (Kaup, Liidtke, & Zwaan, 2006). This conceptualiza¬ 
tion is congruent with the Spinozan model. The schema-plus-tag model is 
the first phase — one thinks of the core of the negation. Only in the second 
phase might one move to the fusion model and encode with the alternative 
affirmative schema. Any interruption or a shortage of resources or time will 
leave us with the first phase only, the schema-plus-tag, which means think¬ 
ing of the core of the negation rather than its actual negation and possibly 
forgetting the negation. However, if this is the case, then it implies that when 
you are standing in the rain, waiting for your bus, and a stranger stops his car 
next to you, opens the window and says, “Hop in! I will take you home,” 
you first consider this offer, thinking for example of getting home faster and 
getting out of the rain, and only later (even if it’s only few milliseconds later) 
will you think of the possible danger. The claim made in this chapter is that 
in such a circumstance you immediately think of the alternative schema that 
exist for this stranger’s offer (being robbed or worse), and you don’t consider 
getting home faster, even for a millisecond. In other words, in this case nega¬ 
tion with the fusion model is a primary process. Still, clearly in this example 
the rejection is thought of as a strategic response. However, the current 
chapter’s conjecture is that the specific reaction - primary negation - that 
occurs in this particular example of distrusting a specific source takes place in 
a general mindset of distrust, which is termed here the skeptical mindset. This 
mindset may be activated by a specific source, by a contextual cue one is not 
aware of, or by a general chronic tendency to distrust others. 

As thinking is for doing (James, 1890) and thought is situated (Schwarz, 
2002; Smith & Semin, 2004; see also Fiedler, Chapter 7 this volume), the 
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cognition of each mindset should adjust accordingly. Thus, if trust means 
taking things at “face value,” cognition should be of a congruent type. If 
distrust means not taking things at “face value,” cognition should be of an 
incongruent type. Therefore, the hypothesis suggested in this chapter is that 
the spontaneous reaction of rejection is the primary process of the skeptical 
mindset, and negation will take place regarding any incoming stimuli, even 
if it is completely unrelated to trust or distrust. Hence, the primary process of 
negation cannot be considered the result of any strategic, effortful, directed 
type of process. This suggests that there is a gullible mindset that has accept¬ 
ance as its primary process, and there is also a skeptical mindset that has 
rejection as its primary process (see Figure 8.2). Because people tend to trust 
others unless they have reasons not to (Berg, Dickhaut, & McCabe, 1995; 
Legal, Chappe, Coiffard, & Villard-Forest, 2012; McKnight, Cummings, 
& Chervany, 1998), the gullible/trusting mindset is considered the default 
mindset. The skeptical/distrust mindset will be evoked by any external 
(processed consciously or unconsciously; Mayer & Mussweiler, 2011; for 
a possible interesting instance, see Oyserman, Chapter 14 this volume) or 
internal cue of distrust, given that some people can be characterized as being 
habitually distrusting (Rotter, 1967, 1971). 

To test the hypothesis of a skeptical mindset that is characterized by a 
primary negation process, we aimed to demonstrate its resulting associa¬ 
tions, processes, and finally reaction to incoming information. To avoid any 
specific strategic explanation, in all studies, distrust - assumed to be the trig¬ 
ger for the skeptical mindset — is manipulated incidentally or measured as a 
personality trait. The effect tested is always regarding a task that is unrelated 
to distrust. Hence, the effect is not a strategic response. The proposition is 
that in a skeptical mindset, compared to a gullible mindset, one considers 
alternative associations rather than the congruent ones, and negates rather 
than accepts; and as a result of these processes one is less influenced by 
incoming information — in other words, less gullible. 

Associations 

In our studies, we have hypothesized that whereas in a gullible mindset 
a congruent flow of activation takes place, thereby activating congruent 
cognitions, in a skeptical mindset, the flow of activation changes and trig¬ 
gers incongruent cognitions. Therefore, in a skeptical mindset, a message 
will spontaneously activate a meaning that is incongruent with the original 
message. To test this, we created 40 sets of three words: a target word (i.e., 
empty) and two possible primes for it; one that is congruent with the target 
(i.e., hollow); and one that is incongruent with the target (i.e., full). The 
participants’ task in the study was to decide if a target word is an adjective 
or a noun (Schul, Mayo, & Burnstein, 2004). We told the participants that 
to create a visual load, we had inserted a face and an additional word. Their 
task concerned only the second word that appeared. Each trial started with 
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the presentation of a face that was trustworthy or untrustworthy for 800 ms. 
Then a prime word was superimposed on the face, below the eyes. After 
being shown for 82 ms, the prime word was replaced by a target word, 
which remained on the screen until a response was made or until a 2-s 
response window closed. The priming word was either congruent or incon- 
gruent with the target. 

The known effect is that people are faster to decide about the target 
word if a congruent prime preceded it, compared to an incongruent prime 
(for a review, see McNamara, 2005). In time measurement this means faster 
responses for targets that appear following a congruent prime compared to 
an incongruent prime. If a distrust contextual cue, such as an untrustworthy 
face, activates the skeptical mindset that spontaneously considers alternatives 
rather than going with the congruent flow of the prime, then the congru¬ 
ency effect should overturn and participants should be faster in responding 
to the target following an incongruent prime compared to a congruent one. 
This is exacdy the pattern of results found in our studies: a significant inter¬ 
action between the type of prime (congruent vs. incongruent) and the face 
(trustworthy/ untrustworthy). 

Participants were faster to respond following a congruent prime if the 
word appeared on a trustworthy face, but they were faster to respond to the 
target following an incongruent prime if the face upon which the words 
appeared was untrustworthy. This finding suggests that indeed an unrelated 
contextual cue for distrust (i.e., an untrustworthy face) leads the mind to an 
incongruent type of activation rather than a congruent one. It is easier to 
think of “empty” following “full” rather than “hollow.” The activation of 
incongruent associations was not the result of a conscious processing strat¬ 
egy, because the prime-target interval was very short (less than 100 ms; see 
Neely, 1977) and because the respondents were unlikely to come up with a 
theory linking the un/trustworthy faces to the facilitation of congruent and 
incongruent targets. 

Hence, we concluded that whereas in a gullible mindset the type of 
active association is of a congruent nature, in a skeptical mindset it is of 
an incongruent nature. As the un/trustworthy faces were a within-subject 
factor, changing from one trial to the next, the findings suggest that the 
two mindsets switch easily and that in the skeptical mindset the negation 
process can happen spontaneously. This finding was replicated using dif¬ 
ferent types of distrust manipulations and even when testing the activation 
using a free association task in which people said out loud the first word 
that came to their mind and we recorded their responses. Following a 
trustworthy face, the free association was of a congruent type, but follow¬ 
ing an untrustworthy face, that free association was of an incongruent type 
(Schul et al., 2004). 

These findings suggest that the skeptical mindset spontaneously activates 
incongruent associations, which we perceive as the end result of a negation 
process. Next we tested the negation process itself. 
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The Underlying Process 

In order to determine whether the skeptical mindset processes information 
differently than the gullible mindset, we turned to a basic bias that is all 
about accepting information rather than rejecting it — the confirmation bias. 
This refers to the human tendency to seek, interpret, and create informa¬ 
tion in ways that verify existing beliefs (Snyder & Swann, 1978; Wason & 
Johnson-Laird, 1972; see also Cooper & Avery, Chapter 16 this volume; 
Dunning, Chapter 12 this volume; Krueger et al., Chapter 6 this volume; 
Myers, Chapter 5 this volume). Is the skeptical mind free from this bias? To 
test this hypothesis we turned to a classic task demonstrating the confirma¬ 
tion bias, the Wason’s (1960) rule-discovery task. In this task participants 
see the series “2 4 6” and are asked to offer what is the underlying rule for 
creating this series. Most participants think that the rule is “+2.” Next, par¬ 
ticipants are given a chance to check out their rule by writing six series that 
will be checked to see if they fit the rule. Most people write other series 
that are congruent with the “+2” rule (Klayman & Ha, 1987; Oswald & 
Grosjean, 2004), such as “10 12 14.” These series conform with the rule 
“+2” and they will be given a check mark, and therefore the participant will 
think that s/he got it right and that the rule is “+2.” However, the rule is 
actually any ascending number. One may find this out only by thinking of 
series that do not fit the “+2” rule, such as “5 6 7” that would be marked 
with a check or “9 7 5” that would be marked with an “X.” Putting forth 
this type of series that does not fit the rule one initially generated is called 
negative testing, as one is testing whether his or her rule is incorrect, in con¬ 
trast to positive testing that confirms only with information that fits one’s 
hypothesis. In order to alter the mindset from gullible to skeptical, before 
the Wason rule-discovery task, we (Mayo, Alfasi, & Schwarz, 2014) asked 
our participants to create an impression regarding a person whose face they 
saw. In one condition that face was trustworthy, and in the other condi¬ 
tion the face was untrustworthy. We asked our participants to keep their 
impression in mind because they will be asked about it at the end of the 
study. The rule-discovery task was presented as a filler task to make it more 
difficult to remember their impression. The hypothesis was that after view¬ 
ing an untrustworthy face, participants will think of more disconfhming 
series, compared to following the trustworthy face. This is exactly what we 
found. Only 16.67% of participants exposed to a trust-inducing face gener¬ 
ated at least one incongruent series, that is, reasoned with negative testing. 
However, 60% of participants exposed to a distrust-inducing face did so. 
Thus, incidental distrust — a face of a person that has nothing to do with the 
task in hand - tripled the proportion of participants who generated at least 
one negative test. Overall, 27.5% of all series in the distrust condition, but 
only 7.4% in the trust condition, were coded as negative tests of partici¬ 
pants’ own hypotheses (for a replication of this effect with a different type 
of distrust manipulation see also Schwarz and Lee, Chapter 13 this volume). 
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We conducted another study where we did not manipulate trust or dis¬ 
trust but rather measured the chronic individual disposition of trusting, 
termed “generalized trust.” This is our general orientation towards the 
social world and the people in it, reflecting an overall conviction that people 
are likely to be reliable, sincere, cooperative, benevolent, and truthful with 
benign intentions (Acar-Burkay, Fennis, & Warlop, 2014; Christie & Geis, 
1970; Rotter, 1967, 1971; Wrightsman, 1974, 1991). Members of an online 
panel were asked to complete allegedly unrelated tasks online. They first 
responded to Yamagishi and Yamagishi’s (1994) six-item trust scale (e.g., 
“Most people are trustworthy”; 1 = strongly agree, 7 = strongly disagree). 
Next they completed the Wason’s (1960) rule-discovery task. The find¬ 
ings replicated the contextual mindset study: Whereas more than two-thirds 
(68.82%) of participants in the lowest-trust quartile generated at least one 
negative test, less than half (48.86%) of those in the highest-trust quartile 
did so. Thus, low-trust participants were more likely to generate negative 
tests than were high-trust participants. This was our first time finding that 
the skeptical mindset may be a personality trait or disposition. We contin¬ 
ued to find that the effects of the skeptical/gullible mindsets apply to both a 
contextually primed mindset as well as a more stable personality mindset in 
subsequent studies (Kleiman, Sher, Elster, & Mayo, 2015). 

The Skeptical Mind: Not Being Influenced by 
Incoming Information 

The findings reported so far demonstrate a skeptical mindset that entails 
a spontaneous negation process with the activation of alternatives to the 
original accessible concept. This effect suggests that in such a mindset, 
the effect of any given concept should be diluted, as it is negated with the 
consideration of its incongruent alternatives rather than congruent ones. 
In other words, incoming information should have less of a congruent 
influence. Thus the gullible/skeptical mindsets may influence the acces¬ 
sibility of mental constructs, which in turn can affect cognitions, feelings, 
and actions (Aarts, Gollwitzer, & Hassin, 2004; Bargh, Chen, & Burrows, 
1996; Bargh, Gollwitzer, Lee-Chai, Barndollar, & Trotschel, 2001; Bargh 
& Pietromonaco, 1982; Dijksterhuis & van Knippenberg, 1998; Higgins, 
1996; Lerner, Small, & Loewenstein, 2004; Schwarz, 2009; Schwarz, 
Strack, & Mai, 1991; Srull & Wyer, 1979). We proposed that the skeptical 
mindset, resulting either from a chronic disposition or from a contextual 
factor, should attenuate or completely eliminate accessibility effects. 

For example, in the basic priming paradigm, famously known as the 
“Donald paradigm,” Higgins, Rholes, and Jones (1977) primed their par¬ 
ticipants either with positive characteristics (e.g., adventurous, confident, 
independent, persistent) or with negative characteristics (e.g., reckless, con¬ 
ceited, aloof, stubborn) and then asked them to read an ambiguous para¬ 
graph describing a person named Donald. The paragraph could lead to a 
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more or less positive impression. The main finding of Higgins et al. (1977) 
was that being primed with positive characteristics led to a significantly 
more positive impression of Donald compared to being primed with nega¬ 
tive trait words, meaning that judgments are affected in a congruent way by 
the priming words. 

We (Kleinian et al., 2015) tested the exact same paradigm with the 
single addition of measuring dispositional trust (Yamagishi & Yamagishi, 
1994) at the end of the study. For participants high in dispositional trust, 
we found a significant accessibility effect such that they rated Donald more 
negatively in the negative-characteristics priming condition than in the 
positive-characteristics priming condition. However, for participants low 
in dispositional trust, the accessibility effect disappeared; the trait primes 
did not inform participants’ judgments as there was no difference between 
the two priming conditions. Importantly, we did not find that the level of 
generalized trust affected the way Donald was judged in general; that is, the 
effect is not due to people low in trust judging Donald overall less or more 
favorably than participants who are high in trust. Rather, the accessibility 
effect of the positive/negative words did not occur. An interesting related 
example of the attenuation of the accessibility effect is the finding that 
distrust reduces stereotyping (Posten & Mussweiler, 2013). A stereotype 
usually leads to congruent judgments of the stereotyped person; however, 
because distrust leads to a spontaneous activation of alternatives - or in 
Posten and Mussweiler’s (2013) terminology, a dissimilarity-focus — the 
congruent effect of the accessible stereotype is reduced. 

Next we turn to embodiment, “bodily priming,” based on the theoreti¬ 
cal stance that mental representations of concepts are grounded in senso¬ 
rimotor experiences (Barsalou, 1999; see also Schwarz & Lee, Chapter 13 
this volume). Embodiment has been shown to affect impression formation, 
judgments, and decisions, as well as behaviors that correspond to the abstract 
concept that the sensorimotor experience makes accessible (e.g., Ackerman, 
Nocera, & Bargh, 2010; Jostmann, Lakens, & Schubert, 2009; Lee & Schwarz, 
2012; Schnall, 2011; Schubert, 2005; Slepian, Young, Rule, Weisbuch, & 
Ambady, 2012; Williams & Bargh, 2008b; Zhong & Liljenquist, 2006; for an 
elaborate theoretical discussion, see Barsalou, 1999; Lakoff & Johnson, 1999). 
We (Kleiman et al., 2015) replicated the 2008 study of Williams and Bargh 
in which participants felt a warm or cold therapeutic pack, judged its qual¬ 
ity, and then moved on to a seemingly separate task of creating an impres¬ 
sion regarding an abstract person. Williams and Bargh’s (2008a) finding is 
that participants who touched a hot therapeutic pack created a significantly 
warmer impression regarding the abstract person compared to participants 
who touched a cold pack. The idea is that the physical warmth is translated 
to the social trait of warmth. 

This time, we did not measure trust but manipulated it. Before touching 
and evaluating the therapeutic pack, participants wrote about an event that 
happened to them in which they could trust/not trust another person. They 
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were asked to remember this event because they would be asked about it 
at the end of the study. This request was made with the aim of keeping the 
distrust-skeptical mindset activated throughout the study. We replicated 
Williams and Bargh’s (2008a) embodiment effect in the trust condition: 
Participants who wrote about a trust event judged the abstract person as 
warmer after touching the hot pack compared to the cold pack. However, 
this effect disappeared in the condition of writing about a distrust event. In 
the distrust condition there was no significant effect for touching the hot 
versus cold pack. It was not the case that the person was judged generally 
better or worse in the trust vs. distrust condition. Also, the evaluation of the 
therapeutic pack was not affected by the dis/trust condition, only translation 
of the physical experience into its social meaning in the trust condition (i.e., 
gullible mindset) but not in the distrust condition (i.e., skeptical mindset) 
(Kleinian et al., 2015). This suggests that in a trust context, the gullible mind 
is affected by the physical warmth in a congruent way, thereby transform¬ 
ing the bodily sensation into its metaphoric cognitive concept (Gallese & 
Lakoff, 2005). However, in a distrust context, the skeptical mind is not 
affected by the physical warmth in the sense that it does not lead to a con¬ 
gruent social judgment. 

As a last example, think of the context of advertising. Ads are embedded 
within content articles on the web, to be seen by consumers in order to 
bring a specific brand to mind, thus making it accessible. Will this acces¬ 
sibility effect of an ad fade in a skeptical mindset? An identical set of two 
different static ads for a well-known brand of diapers was planted in 
two different “online” articles, which varied in the dimension of trust (but 
were similar in shape and length). In the control condition the article was 
about a person’s unique hobby of raising homing pigeons. In the skepti¬ 
cal condition the article presented findings of a recently published State 
Comptroller report listing the ways in which citizens are being deceived by 
government institutions. Participants thought that the study was about read¬ 
ing and comprehension of web articles. They read the article, scrolling down 
as the two ads appeared, one in the middle of the article and one at the end. 
Then they were told that in order for some time to pass before being tested 
about the article, they are requested to answer a business school survey. 

The survey began by asking the participant to name a familiar brand of 
toothpaste, followed by several evaluation questions regarding the brand. 
The next question was to name a brand of diapers one is familiar with, again 
followed again by several evaluation questions about the brand. The find¬ 
ings were that 62.5% of the participants in the baseline condition named the 
advertised “brand A” as a brand they were familiar with, but only 18.7% 
of the participants in the skeptical condition did so (Kleiman et al., 2015). 
Thus, within a control context, exposure to an ad makes the advertised 
brand more accessible. However, in the context of distrust (skeptic mind¬ 
set), this accessibility effect diminishes, as the advertised brand loses its 
advantage over possible alternatives (i.e., competing brands). 
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Conclusion: The Gullibility of the Mind Is 
Context-Dependent 

The current chapter’s main claim is that negation can be a successful pri¬ 
mary process reducing gullibility. First, one needs an affirmative alterna¬ 
tive schema that carries the meaning of the negation in order to be able to 
successfully negate. Second, if the mind is in a context of distrust, due to 
situation or personality, then a skeptical mindset emerges, one of primary 
rejection. Specifically, the accompanying default result of the comprehen¬ 
sion process is likely to be context-dependent. A mind may be gullible, in 
which comprehension equals acceptance and rejection is a secondary pro¬ 
cess, or skeptical, in which comprehension equals rejection and acceptance 
is a secondary process (see Figure 8.2). 

Beyond the primary mode and ease of the negation process in a skep¬ 
tical mindset, the fact that the mindset is pre-activated may be a critical 
factor in the ability to negate. When negation is explicitly communicated 
in a semantic manner, such as “the umbrella is not open” (Deutsch et al., 
2006; Kaup et al., 2006), or in an explicit instruction to negate, ignore, dis¬ 
count, or correct information (DeCoster & Claypool, 2004; Fazio, Barber, 
Rajaram, Omstein, & Marsh, 2013; Gilbert et al., 1993; Martin, Seta, & 
Crelia, 1990; Nisbett & Wilson, 1977; Skumik, Yoon, Park, & Schwarz, 
2005; for a review regarding misinformation, see Lewandowsky, Ecker, 
Seifert, Schwarz, & Cook, 2012; Rapp & Braasch, 2014), it makes sense 
that the person first activates the original information and then considers 
its negation. In the skeptical mindset, in contrast, negation is not explicitly 
presented but is rather self-generated. Critically, the claim is that for the 
skeptical mindset, negation is the primary, default process. One of the main 
factors enabling successful negation and correction is being prepared to 
negate before receiving the information (Lewandowsky et al., 2012; Schul 
Burnstein, & Bardi, 1996). Accordingly, one could naturally and easily cor¬ 
rect for information received when one is already in a skeptical mindset. To 
conclude, the claim presented is that when we know better (equipped with 
an alternative schema and context), we are utterly non-gullible. 
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Figure 8.2 The Cartesian and Spinozan models. 

Source: Adapted from Gilbert (1991) with the addition of the skeptical mindset outlined in 
this chapter. 
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Note 

1 This study was conducted in Hebrew, in which there are no prefixes or suffixes; 
rather, a negation is communicated only by use of the separated word “not” (e.g., 
"not happy,”“not responsible”). 
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Approaching Gullibility 

In its German translation, “gullibility” means “leichtglaubig,” literally trans¬ 
lated: “eager to believe,” in a more social context “easy to be convinced.” 

Of course, the easiest way — perhaps another type of gullibility — is to 
consider this characteristics as a feature of personality. Within the frame¬ 
work of the “big five” (e.g., Borgatta, 1964), gullibility might perhaps be 
described as a blend of high “openness” and low “conscientiousness.” 

The second approach is more social in nature. One may ask about per¬ 
suasive techniques that promote the acceptance of a message without being 
convinced by its content, a persuasion that is based on impression manage¬ 
ment (Hass & Mann, 1976; see also Cooper & Avery, Chapter 16 this vol¬ 
ume; Myers, Chapter 5 this volume). 

Finally, one may go one more step in a reductionist direction and ask 
about the psychological processes that facilitate believing. And of course, 
social cognition is the discipline that may provide insights that may help 
to understand the underlying mechanisms (see also in this volume: Fiedler, 
Chapter 7; Forgas, Chapter 10; Krueger, Vogrincic-Haselbacher, & Evans, 
Chapter 6; Unkelbach & Koch, Chapter 3). 

Gullibility: Heuristically Generated 

It is obvious that gullibility can be produced by heuristics (Tversky & 
Kahneman, 1974; see also Strack & Deutsch, 2002). As it is well known, 
heuristics describe ways in which judgments can be simplified. If judg¬ 
ments express beliefs, heuristics can be understood as promoters of gul¬ 
libility. Indeed, at the beginning of this research program, heuristics had a 
pejorative flavor and were often described as judgmental fallacies resulting 
from deviations from normative rules. This was particularly reinforced by 
efforts to link psychological biases with judgmental heuristics (e.g., Nisbett 
& Ross, 1980). 

Subsequendy, however, heuristics were increasingly seen as strategies that 
simplify judgments by reducing their complexity with the goal of making 
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them easier, less effortful and faster to execute. In fact, it has been argued 
that under specific circumstances, heuristics may even improve human 
judgment (Gigerenzer & Gaissmaier, 2011). As a consequence, one may 
wonder if the negative associations elicited by “gullibility” due to heuristic 
use deserve to be examined more closely. 

As much as heuristics are candidates as determinants of gullibility, there 
is one severe problem: Heuristics do not share a single, common psycho¬ 
logical property. As much as they converge in their consequences, namely 
facilitating and accelerating the judgmental process, their operation cannot 
be reduced to a joint mechanism. As Kruglanski and Thompson (1999) 
had pointed out in their “unimodel,” simplified judgments are cut from 
the same psychological cloth as their more systematic counterparts, because 
they are based on syllogistic inferences. Of course, the various bases of such 
inferences may differ and this may depend on the goal of the judgment. 
Thus, assessments of frequency or probability may be built on the expe¬ 
rienced ease with which a given content can be retrieved (Schwarz et al., 
1991) or recognized (Goldstein & Gigerenzer, 2002; see also Oyserman, 
Chapter 14 this volume; Unkelbach & Koch, Chapter 3 this volume) while 
the similarity with a prototype may be harnessed to consider a category 
membership (e.g., Tversky & Kahneman, 1982). In an attempt to reach 
an overarching understanding of the operation of heuristics, Kahneman 
and Frederick (2002) have proposed “attribute substitution” as a com¬ 
mon denominator. For example, while systematic judgments are based 
on normative parameters of logic or probability, heuristic simplification 
may replace them with peripheral assessments that are, imperfectly though, 
related to them. The similarity of a target with the prototype of a category 
is one prominent example. Linda, whose characteristics fitted that of a 
liberal activist was less likely to be seen as a banker than as a banker who 
is active in the feminist movement. The neglect of the most basic rule of 
probability theory led to the so-called “conjunction fallacy” (Tversky & 
Kahneman, 1982). 

However, if heuristics are not defined as deviations from normative rules 
but as simplifications of comparatively complex and effortful judgmental 
procedures, the heuristic nature of a judgmental procedure is defined in 
contrast to a less heuristic way of generating a judgment. For example, to 
estimate the relative size of cities, the recognition heuristic is a simplifica¬ 
tion compared to searching for the relevant information in an encyclopedia, 
which may be characterized as “systematic.” At the same time, to be even 
more precise, one might consult the official statistics. Thus, depending on 
the reference point, searching the encyclopedia may be described as a strat¬ 
egy that is both systematic and heuristic in nature, depending on the basis 
of comparison. 

This suggests that the terms “heuristic” and “systematic” do not describe 
psychologically defined categories of human judgment but are synonyms for 
“simple” and “complex” as endpoints of a scale of judgmental complexity. 
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To be sure, if the additional time and effort does not increase the adaptive 
value of accuracy, there is no reason to assume that complex is always better. 
As a consequence, the search for the determinants of gullibility must con¬ 
tinue and focus on the psychological mechanisms involved. One way would 
be to generate a list of those cues and mechanisms that are involved in 
various heuristics. This strategy, however, runs the risk of coming up with 
an infinite number of specific procedures, which are employed with the 
intention to simplify one’s judgment. Alternatively, one might take a closer 
look at the general dynamics of human judgment and identify overarching 
psychological/cognitive principles that facilitate beliefs with or without a 
concomitant intention. 

From Heuristics to Social Influence: Exploiting Gullibility 

Social influence is typically understood as a type of compliance and con¬ 
formity (Cialdini & Goldstein, 2004). Motivational forces were typically 
associated with the positive consequences of complying and conforming 
and/or the negative consequences of failing to do so. Thus, the influence 
was seen to be mediated by rewards or punishments as a function of the 
target’s behavior. 

Frequently, however, social influence may be more effective if it affects 
the targets’ judgments in ways that are not immediately obvious. This is the 
case if it is not the outcome that causes pleasure or pain but the process 
that itself varies in pleasantness. This applies if the generation of a judg¬ 
ment requires little or much effort. And this is exactly what heuristics are 
all about: simplifying judgments. Thus, social influence may be effectively 
achieved by offering heuristics that result in the desired outcome. 

This is exactly what Robert Cialdini has described in his book, Influence: 
Science and Practice (1985). Instead of using external reward and punish¬ 
ment, Cialdini identified tendencies within the individual to be harnessed 
for the purposes of the influencer. This “jujitsu” strategy includes the reli¬ 
ance on simple rules (e.g., reciprocity) and the simplification of judgments. 
Comparison plays a crucial role. For once, there is “perceptual contrast” 
that is driven by the deviance from an adapted state of experience, like 
the felt temperature of lukewarm water after having held one’s hand in ice 
water. However, the perceptual nature that presupposes adaptation is not 
necessary. Mere judgmental mechanisms will suffice. Perhaps best known, 
Cialdini (1985) describes the letter of a young female college attendant 
who makes her parents believe that she was pregnant and about to bring 
home a socially unacceptable husband, only to reveal that these stories had 
been invented to justify her receiving poor grades in her studies. As much 
as adaptation may intensify experiences of contrast, the judgmental effect 
and its behavioral consequences do not need a perceptual representation 
(Kahneman, 1999). As we shall argue, the accessibility of the standard and 
the ease comparison will play a crucial role. 


162 Fritz St rack 


The second type of comparison discussed by Cialdini is assimilative in 
nature. It describes a type of social comparison (Festinger, 1954) that vali¬ 
dates people’s own assessments based on the judgment and behaviors of oth¬ 
ers (see also Cooper & Avery, Chapter 16 this volume). Interestingly, this 
assimilation affect also has a perceptual component when it comes to social 
contagion, e.g., when laughing or yawning by others functions as cues guid¬ 
ing a response. Most important, it provides a “social proof’ that releases 
judges from assessing the situation and allows them to facilitate the process 
by simply following the others. Often, the validity of an assumption may 
be quantitatively evaluated by the number of others who behave in a cue- 
consistent manner. However, to the degree that their behavior was socially 
based as well, the validity assessment may be misleading. Also, others’ prefer¬ 
ences may differ from one’s own. Even if “millions of flies can’t be wrong,” 
the proof of the observation depends on its transferability across individuals. 

To overcome the traps of mere frequency, authority and expertise are 
identified as characteristics that further validate social influences. Even if 
such “peripheral” (e.g., Petty & Cacioppo, 1986) cues do not differ in the 
basic psychological mechanisms that result in the judgment (Kruglanski & 
Thompson, 1999), they facilitate the process compared to a more elaborate 
evaluation of the “central” aspects of the facts. 

Of course, the existence of these judgmental facilitators or cues suggests 
that their presence liberates judges from weighing pros and cons. Even if 
there exist no pertinent data, it can be assumed that these simplifying aspects 
contribute to gullibility. 

Social Cognition 

As a basic model, the paradigm of information processing provides a frame¬ 
work in which human judgments are generated. They are understood as the 
result of information processing, which consists of the encoding, categori¬ 
zation, storage in memory, retrieval, and syllogistic inferences. In a more 
elaborate variant of the basic model, we (Strack & Deutsch, 2004, 2015) 
attempted to integrate different modes of information processing and link 
them to affect and behavior. 

Specifically, we identified two processing systems that follow distinct 
principles. The impulsive system (IS) directs behavior by linking external 
cues to behavioral schemata based on previously learned associations. The 
internal responses that are generated during its operation can be conceived 
within the reflective impulsive model (RIM) as a network in which informa¬ 
tion is processed automatically through a fast and parallel spread of activa¬ 
tion along the associative links between contents. In contrast, processes of 
rule-based reasoning and of symbol manipulation are assumed to be carried 
out in the reflective system (RS). Although this enables greater flexibility, the 
reflective system operates slowly, tends to be disrupted by other processes, 
and depends on intention and effort. 
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The Impulsive System 

Specifically, the IS represents environmental regularities as patterns of activa¬ 
tion in an associative network. Links are created or strengthened if stimuli are 
presented in close temporal or spatial proximity. The IS works like a simple 
memory system (see Johnson & Hirst, 1991) that slowly forms enduring, non- 
propositional representations of the typical properties of the environment (see 
McClelland, McNaughton, & O’Reilly, 1995; Smith & DeCoster, 2000). 
Propositional knowledge cannot be represented in the impulsive system. 

Processes in the impulsive system may be accompanied by an experien¬ 
tial mode of awareness. Specifically, processing a stimulus elicits three types 
of feelings. First, it triggers feelings related to the physical senses, such as 
colors, sounds, or tastes (see also Schwarz and Lee, Chapter 13 this volume). 
Second, based on innate or learned links, it triggers positive or negative 
affective feelings (see also Forgas, Chapter 10 this volume). Third, it triggers 
cognitive feelings, such as familiarity or ease (see also Unkelbach & Koch, 
Chapter 3 this volume). Generally, these feelings are assumed to result from 
strong stimulation of specific perceptual and affective structures within the 
impulsive system. Sources of activation are external perception of a stimu¬ 
lus, reflection about the stimulus, and spreading activation to stimulus rep¬ 
resentations from associated representations. 

Consider, for example, an individual who repeatedly sees, smells, and 
finally buys and eats a piece of cake in a bakery. On the basis of the described 
principles, all sensory and motor representations that take place during the 
episodes will be linked, and an associative cluster that relates to cake will be 
created. When the person encounters a similar situation and engages in think¬ 
ing about cakes or related concepts, this cluster will be activated again and lead 
to anticipatory sensations of taste and smell, as well as to the anticipation of 
the pleasure of sweet taste. Likewise, behavioral schemata that are related to 
eating will be activated. One striking example is the phenomenon of “impulse 
buying,” when consumer behavior is not determined by rational choice but 
by affective determinants (see Hofmann, Strack, & Deutsch, 2008). 


The Reflective System 

In contrast, the RS serves regulatory and representational goals that com¬ 
plement the operation of the impulsive system. It is in charge of generat¬ 
ing explicit judgments and decisions and of performing executive functions 
such as overcoming habits or putting together action plans in new situations 
(Lieberman, 2003). To fulfill these functions, reflective processes are based 
on symbolic representations, which are momentary re-representations of 
the concepts stored in the impulsive system. Only the reflective system can 
combine symbols flexibly by syllogistic operations. This flexibility, how¬ 
ever, comes at the cost of slow processing and a great instability of rep¬ 
resentations in the RS. Such representations need to be rehearsed during 


164 Fritz Strack 


operation, which activates the corresponding concepts in the impulsive sys¬ 
tem. Representations of this kind are a prerequisite for generating explicit, 
propositional judgments and decisions, as well as for correcting judgments 
to increase their accuracy and or socially desirability. Of course, motiva¬ 
tional as well as situational factors may affect the accessibility of information, 
which may subsequently bias inferences in a direction that meets the desires 
of either the person or an outside influencer. 

If knowledge has been generated, syllogistic rules allow inferences that “go 
beyond the information given” (Bruner, 1973). Through reflection, the per¬ 
son exposed to a cake may link the perceptual input to a suitable category (i.e., 
cake, pie). In addition, elements that are associated with the category (e.g., 
sweet) may be activated and used for further reasoning. For instance, from the 
property of sweetness a high calorie content and a damaging potential may be 
inferred. These inferential processes are fundamentally different from the mere 
activation of associations in memory described above because they connect 
the activated contents, resulting in propositional knowledge, or beliefs. While 
the mere activation of the concept facilitates the inference, it does not create 
knowledge about cakes being high in calories. This knowledge, in turn, may 
be employed to form a behavioral decision (e.g., not to buy the cake). 

This distinction is particularly important to understand negations. They 
are cognitive operations that only occur in the reflective system (see also 
Krueger et al., Chapter 6 this volume). Importantly, if they do not involve 
the cognitive creation of a concomitant affirmative representation, they will 
create associative traces in the impulsive system that correspond to the non- 
negated information. As a consequence, just saying “no” is not sufficient to 
create stable representations that reflect the content of a negation (Deutsch, 
Gawronski, & Strack, 2006; Gawronski, Deutsch, Mbirkou, Seib, & Strack, 
2008; see also, Mayo, Chapter 8 this volume; Douglas, Sutton, & Cichocka, 
Chapter 4 this volume; van Prooijen, Chapter 17 this volume). 

Operations of the reflective system may be accompanied by an awareness 
that something is or is not the case. Such noetic states of awareness may be 
accompanied by experiential states of awareness. For example, trying to answer 
an almanac question may be accompanied by a feeling of knowing (Koriat, 
1993) that is not the same as actually knowing that something is the case. 
This feeling may be triggered by peripheral characteristics of the answer that 
are unrelated to the required information, for example, that the answer starts 
with a certain letter. A particularly striking example comes from Alter and 
Oppenheimer (2006) who found that at the stock exchange, newly emitted 
shares were more successful if their names were easily pronounceable. 

Gullibility from the Perspective of the Reflective 
Impulsive Model ( RIM) 

The RIM provides a theoretical framework that allows us to look at the 
cognitive determinants of gullibility from a more systematic perspective. 
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Specifically, it describes several psychological routes on which judgments 
can be simplified and thus increase the likelihood of belief and the possibil¬ 
ity of gullibility. 

It is important to note that judgments are based on beliefs that are propo¬ 
sitional in nature. That is, we assign a characteristic to a target and assign a 
truth value to the resulting characterization. From the vantage point of the 
RIM, this is produced by the RS. However, its effortful operations can be 
simplified in different ways. Moreover, existing heuristics can be under¬ 
stood in their underlying psychological dynamics. 


Accessibility of Information (and Anchoring) 

Most importantly, the mere accessibility of information in the IS operates as 
a major judgmental determinant. Prior activation in close temporal distance 
is the best guarantee that a piece of applicable information will simplify and 
shortcut the search for further information. U.S. President Trump, who 
is frequently described as highly impulsive in his decisions, is known to 
be influenced the most by those advisors with whom he has spoken most 
recently, which illustrates the influence of accessibility in a natural setting 
(see also Cooper & Avery, Chapter 16 this volume; Myers, Chapter 5 this 
volume). Priming research has demonstrated the operation of accessibility 
in a great number of studies showing that the influence may operate auto¬ 
matically without an awareness of the priming episode (see Cheesman & 
Merikle, 1984). 

At the same time, reflective operations may affect the ease with which an 
information comes to mind. An example is judgmental anchoring that was 
mentioned as a heuristic by Tversky and Kahneman (1974) next to “avail¬ 
ability” and “representativeness.” The phenomenon is an assimilation of an 
absolute judgment toward the standard of a preceding comparative judg¬ 
ment. Best known is a study by Tversky and Kahneman (1974) in which par¬ 
ticipants were provided with a randomly generated number that served as a 
standard to decide if the proportion of African nations in the UN was higher 
or lower. Subsequently, when judges had to assess the true proportion, their 
judgments were distorted into the direction of the previous standard. 

Of course, providing a standard in a natural conversation typically sug¬ 
gests that the true value is somewhere in the vicinity. Thus, gullibility is 
influenced by the intention of the communicator. Tversky and Kahneman 
(1974), however, excluded this possibility by openly generating the stand¬ 
ard in a random fashion. The resulting assimilation effect must be explained 
without invoking communicative influences. The original authors proposed 
“insufficient adjustment” as an underlying mechanism. However, this expla¬ 
nation seems to beg the question without suggesting a psychological mecha¬ 
nism. As a consequence, Thomas Mussweiler and I (Mussweiler & Strack, 
1999; Strack & Mussweiler, 1997) approached the phenomenon from an 
information-processing perspective. Specifically, we assumed anchoring to 
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be the result of semantic priming. This assumption gave rise to a more elabo¬ 
rate “selective accessibility model” that was corroborated in a number of 
experiments. The model assumes that to generate a comparative judgment, 
relevant information must be retrieved from memory. Simultaneously, the 
provided standard operates like a baseline hypothesis to be tested. That is, 
people who were asked if the proportion of African states in the UN is 
higher or lower than a high anchor of 65% are assumed to have tested the 
possibility that the proportion is 65% and then responded by providing infor¬ 
mation about the direction in which the retrieved information deviated from 
the standard. However, research on hypothesis testing has shown that this 
information search is selective such that hypothesis-consistent information 
(e.g., “Many African nations that are members of the UN come easily to 
mind”) will be more likely to be retrieved than inconsistent information. 
Even if the hypothesis is rejected, this type of activation in the RS will cause 
the consistent information to remain accessible and enter into the absolute 
judgment as a source of potential gullibility. 

This conceptualization of anchoring as a knowledge accessibility effect is 
supported by a large body of evidence demonstrating that anchoring effects 
share many of the qualities that are typical for knowledge-accessibility 
effects in general. First, anchoring effects depend on the applicability of the 
knowledge that was rendered accessible by the comparative task. A second 
aspect is the similarity in use of the accessible information. Research on 
the judgmental effects of accessibility has repeatedly demonstrated that the 
direction of an influence depends on how similar the accessible knowledge 
is to the judgmental target. If an accessible concept is similar, it is typically 
used as a basis for the judgment, which leads to assimilation and possible 
gullibility. If, however, an accessible concept differs largely from the target, 
it will be used as a standard of comparison, which produces a contrast effect. 
For example, comparing the mean winter temperature in the Antarctic to a 
high versus low anchor (20 °C versus 50 °C) produced an assimilation effect 
on absolute judgments of temperatures in the maximally similar Antarctic 
while the same comparison produced a contrast effect on absolute judg¬ 
ments of temperatures on maximally dissimilar Hawaii. Thus, the direction 
of anchoring effects appears to depend on the similarity of the activated 
concept and the judgmental target, just as is true for knowledge-accessibility 
effects in general. 

A third feature that anchoring and knowledge-accessibility effects have 
in common is that the degree of accessibility of judgment-relevant knowl¬ 
edge determines the time and effort that is needed to make a judgment. 
This pattern was replicated in the anchoring domain where response laten¬ 
cies for the absolute judgment depended on the extent to which the acces¬ 
sibility of relevant knowledge had been increased during the preceding 
comparative task. 

However, different levels of accessibility do not only influence the 
speed of absolute judgments, but also their content. That is, judges who 
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generate more anchor-consistent knowledge during the comparative task 
because they are in a sad mood, which is typically associated with more 
elaborate processing, should show larger anchoring effects than judges in a 
neutral mood. 

A final characteristic of knowledge accessibility effects that is shared by 
anchoring is its temporal robustness. Knowledge accessibility effects are typ¬ 
ically long-lasting, provided they are not superimposed by other applicable 
information. The same temporal robustness also characterizes judgmental 
anchoring. In particular, it has been demonstrated that anchoring effects still 
occur if the comparative and absolute questions are separated by one week. 

In summary, this line of research demonstrates how the dynamics of basic 
cognitive processes can be harnessed to understand heuristics whose under¬ 
lying mechanisms have not been sufficiently understood. Moreover, it sheds 
light on mechanisms of comparison that simplify social judgments in many 
domains. That is, they show how comparisons may ease and distort categor¬ 
ical judgments and they explain how people can be manipulated by being 
induced to engage in specific comparisons. As a consequence, the analysis 
of the cognitive processes underlying heuristics and comparative judgments 
may contribute to a better understanding of the resulting gullibility. 

Comparisons in Social Settings as a Source of Gullibility 

One of the first theories of modem social psychology was Festinger’s (1954) 
theory of social comparison processes. It was a seminal attempt to under¬ 
stand interindividual processes by identifying their underlying intraindivid¬ 
ual, cognitive dynamics. Its first hypothesis identifies individuals’ needs to 
evaluate their opinions and abilities. More important, its second hypothesis 
is about social facilitation. Specifically, it claims that “to the extent that 
objective, non-social means are not available, people evaluate their opinions 
and abilities by comparison . . . with the opinions and abilities of others” 
(p. 118). Festinger has not only pointed at the readiness to be influenced by 
others, he has also pointed at the determinants that initiate or prevent com¬ 
parisons. In particular, he has identified the difference between one’s own 
characteristics and those of the comparison person to be a main obstacle for 
comparisons. Importantly, he has identified a motivational component that 
he calls a “unidirectional drive upward,” which applies if abilities are com¬ 
pared, but not if the comparison is about opinions. Finally, comparisons are 
terminated if they turn out to be unpleasant. 

Festinger’s (1954) theory was the starting point of a social psychology 
that is based on cognitive operations. Even if their structure was more in 
the focus than their temporal dynamics, social judgments have occupied a 
focal point ever since in social psychology (Suls & Wills, 1991). As Festinger 
(1954) has aptly observed, these judgments were driven by two motives that 
might occasionally stand in conflict: truth and positive feelings about one¬ 
self. Under the label “downward comparison” the latter has subsequendy 
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(e.g., Wills, 1981, 1987) stimulated a new research program that proved to 
have even therapeutic implications (Taylor & Lobel, 1989). 

In social-cognition research, comparative judgments were often embed¬ 
ded in more basic mechanisms of priming. Specifically, the activation of 
information was found to influence the generation of judgments. However, 
this influence may occur in two directions, assimilation and contrast, 
depending on the similarity of the target and the prime. That is, if informa¬ 
tion about others is sufficiently similar to the target, it may serve as a cue to 
elicit related information that will become the basis of the judgment, which 
will become more similar. However, if the accessible information is very 
dissimilar to the target, it may serve as a standard and generate a contrast 
effect (Herr, Sherman, & Fazio, 1983). 

Similarity may also be created by superordinate categories. That is, if a 
category is activated that causes the target and the standard to belong to 
together, the target will be judged to be more similar. However, if the con¬ 
text suggests that the two belong to different categories, they will be judged 
to be more different. As a consequence, the same piece of information can 
produce both assimilation and contrast effects and thereby foster gullibility. 

Assimilation versus Contrast Explained 

Schwarz and Bless (1992; see also Bless & Schwarz, 2010) have proposed 
an “inclusion/exclusion model” that describes the underlying mechanisms. 
It assumes that evaluative judgments require mental representations of both 
the target of judgment and a standard against which the target is evalu¬ 
ated. Both representations draw on information that is most accessible at the 
time of judgment. The degree of accessibility. However, the way accessible 
information influences the judgment depends on its use. If the information 
is used in forming a representation of the target, assimilation will occur such 
that the features in the representation of the target result in a corresponding 
representation and, as a consequence, in a corresponding judgment. The 
size of the assimilation effect is assumed to increase with the amount and 
the extremity of relevant information that is included in the representation 
of the target. 

According to the model, contrast effects can take two forms. First, 
excluding a corresponding attribute results in a less converging representa¬ 
tion of the target and hence in a less converging judgment. Like assimilation 
effects, this subtraction-type of contrast effect is based on changes in the 
representation of the target and therefore limited to evaluations of this spe¬ 
cific target. Subtraction-based contrast effects are assumed to increase with 
the amount and extremity of converging information that is excluded from 
the representation of the target. 

Second, the inclusion/exclusion model states that if information has been 
excluded from the representation of the target it may also be used in con¬ 
structing a representation of a standard. If this information is converging, it 
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results in a more positive representation of the standard, relative to which 
the target is evaluated more differently. These comparison-based contrast 
effects generalize to all targets to which the standard is applied. Their size 
increases with the amount of converging information that is used in con¬ 
structing the standard. Thus, the model predicts the direction (i.e., assimila¬ 
tion versus contrast) and size of context effects, as well as their generalization 
across targets. More importandy, It demonstrates how easy is to influence 
judgments in opposite directions. 

While assimilation versus contrast can be elicited by a variety of vari¬ 
ables (Bless & Schwarz, 2010), one determinant seems to be particularly 
important. It is the categorization of the standard that allows the target 
to be subsumed or not. In an early study, Bless and Schwarz (1998) had 
asked participants different questions about their political knowledge, one 
of them about Richard von Weizsacker who was a highly respected (for¬ 
mal figure head) president of Germany and a member of the Christian 
Democratic Union (CDU), a party that was held in very low regard at the 
time. Depending on conditions, the participants were either asked about 
the name of the party Weizsacker had belonged to for more than 20 years 
or about his office that sets him aside from party politics. As predicted by 
the inclusion/exclusion model, participants’ subsequent evaluations of 
Weizsacker’s party were more positive if the preceding question triggered 
his inclusion in, rather than his exclusion from, the representation they had 
formed of his party. This suggests that through mere accessibility of differ¬ 
ent characteristics, a target may influence judgments in opposing directions. 

The Ease of Forming Comparative Judgments 

This research shows that contrast effects may not only be the results of 
outright comparisons. They may also be caused by selective accessibility. 
To trigger and facilitate comparisons, commensurability must be created. 
Popular knowledge has it that you cannot compare apples with oranges. 
Much less should it be possible to relate buying a car to forgoing an over¬ 
seas family vacation. In economics, however, such comparisons are believed 
to be the basis for the assessment of subjective utility. Under the name of 
“opportunity costs” (e.g., Rieskamp & Hofffage, 2008), economic agents 
are assumed to compare what they are willing to give up or do without if 
they acquire a new good. Opportunity costs are often defined as “the next 
best choice” or the “loss of other alternatives when one alternative is cho¬ 
sen.” Thus, the value of the loss or the waiver can be taken to assess the 
utility of a purchase. 

Psychologically, however, it is highly questionable if such a compara¬ 
tive assessment is commonly taking place. To be sure, important decisions 
that involve major expenses may trigger purchases one has to renounce. In 
daily life, however, assessing the opportunity costs to generate a compari¬ 
son standard seems to be rare. For once, the “next best alternative” is not 
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really a loss but can be acquired as well. More important, perhaps, is the 
fact that preferential comparisons need a common dimension on which the 
target and the standard can be allocated. This may require some effort and 
involve ambiguities that need to be resolved. If a decision has to be made 
between a new kitchen and a family vacation, it involves comparisons on 
many dimensions that need to be weighed in order to enter into a global 
preferential decision. 

At the same time, providing such a dimension gready facilitates com¬ 
parisons and induces people to reach desired conclusions. Perhaps, the most 
effective facilitator of comparisons is the dimension of money. On an inter¬ 
val scale with a natural zero point, the value of a good can be described with 
any desired numerical exactness. However, the result of comparing differ¬ 
ent targets on the same value dimension may have been caused by different 
characteristics and preferences implies a comparison of these characteristics. 
If I like alterative A better than B, it is not necessarily due to the fact that 
A has more of what I like than B. Instead, it may be the case that the two 
alternatives have different characteristics and I like that of A more than that 
of B, which may require some serious deliberating. 

Thus, the easiest way of comparing is when the same target causes dif¬ 
ferent losses. If the same product is cheaper in outlet A than in outlet B, 
the evaluator may consider a purchase from A good deal. Of course, B 
may try to reduce the commensurability by pointing at peripheral charac¬ 
teristics that may revalue the product, such as the location of the shop or 
consulting and support. Therefore, the ease of comparison can be further 
increased by comparing the target with itself at different times. Such an 
intra-target comparison typically occurs on a temporal dimension such 
that the current price has been reduced compared to a higher price some 
time ago. Alternatively, the current price is offered for only a limited 
period of time and it will be increased in the future. Advantageous mone¬ 
tary comparisons are often advertised as “saving.” Ironically, its definition 
as “income not spent” is turned into its opposite “saving by spending.” 
Obviously, the arbitrary use of comparison standards combined with the 
ease of comparing on the joint evaluative dimension provides an ideal 
instrument of social influence. Thus, even if the recipients are convinced 
to have achieved a “good deal,” it has induced a type of gullibility that 
was produced by directing the evaluation from the characteristics of the 
target to the relative utility of the purchase. The arbitrariness of the stand¬ 
ard affords influencing people’s choices in a powerful way that effectively 
obscures the lack of rationality by making them believe that they have 
made a good decision. 

Comparative Judgments in the Ultimatum Game 

Such judgments and decisions deviate from assumptions of economic ration¬ 
ality if the standard is merely a reference point but not an actual alternative 
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to be chosen. It is therefore not surprising that comparisons play a major 
role in the so-called anomalies in microeconomics (Thaler, 1988; see also 
Krueger, Vogrincic-Haselbacher, & Evans, Chapter 6 this volume). Perhaps 
best known is the “ultimatum game,” where players have to agree on the 
distribution of a given sum of money. Specifically, proposers suggest the 
proportion that they want to keep for themselves and the resulting propor¬ 
tion for the responders. If the responder agrees, the money will be distrib¬ 
uted as proposed. If, however, the responder does not accept the proposed 
distribution, nobody will receive anything. 

From the vantage point of economic rationality, responders should accept 
any offer that gives them a share above zero. However, numerous studies 
(see Giith, 1995) have demonstrated that offers resulting in shares below 
40% are frequently rejected. This “anomalous” and irrational behavior has 
been explained by invoking the concept of fairness (Fehr & Schmidt, 1999). 
Specifically, it has been argued that proposers violate the social norm, which 
should be sanctioned to maintain it. 

Whatever explanation is preferred, the irrational choice is always driven 
by a comparison standard, namely 50% standing for an equal distribution. 
It generates a conflict between the rationally prescribed acceptance of any¬ 
thing above zero and the relatively disadvantageous outcome. 

More generally, however, comparative assessments can be aggravated if 
relative judgments are in conflict with the possibility of consumption, which 
is the basis of rational choice. This will be intensifies if the responder’s focus 
is directed on the consummatory consequences of deal. In other words, if 
responders are primed with what they can do with the money, its relative 
value is less important. 

This was shown in two studies (Ziim & Strack, 2017) in which par¬ 
ticipants in the ultimatum game were induced to think about what they 
would do with the money (or a corresponding gift voucher) they were 
to earn. Specifically, to activate specific consumption opportunities, these 
participants had to contemplate for 1 minute what they could buy with the 
gift voucher. Therefore, we presented them with the ten main product cat¬ 
egories offered by Amazon.com and asked them to select the category from 
which they would most likely buy something. 

We predicted that responders would be less likely to engage in com¬ 
parative assessments and accept more disadvantageously unequal offers if 
consumption was primed and therefore more accessible than in the control 
condition where the deviation from the standard was assumed to be more 
important. This results indicated that this was the case. That is, the accept¬ 
ance rate of responders for whom the consumption was primed was signifi¬ 
cantly higher than that for the no-priming control group. 

In a second, replication study, the conflict between the two types ofjudg- 
ments (consumption versus distribution based) was assessed by recording 
responders’ response latencies. Indeed, responders for whom the consump¬ 
tion possibilities had been primed took longer to decide than the no-priming 
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control group. That is, if conflict is an indication of reduced gullibility, 
aggravating comparative judgments may be a means in that direction. 

In another set of experiments (Ziim, Schmidt, Hewig, & Strack, unpub¬ 
lished) we manipulated their difficulty in a more direct fashion. Specifically, 
we told responders in the ultimatum game that the game would be played 
with foreign currencies whose value would be converted into euro cents. 
As a consequence, both the amount to be distributed by the proposer and 
the share offered to the respondent were uneven numbers, which made 
it difficult to calculate the exact proportion or deviation from the mean. 
This manipulation was innovative because in previous publications, the full 
amounts were typically reported as multiples of ten, which made deviations 
from the mean rather obvious. As Figure 9.1 shows, while we replicated the 
typical rejection of unfair offers, the response latencies were significandy 
increased for the converted currencies were increased when it was more 
difficult to calculate the proportions. 

Moreover, responders were more likely to accept offers below an equal 
distribution if the amount could be easily converted into proportions than 
if this was more difficult (see Figure 9.2). This is another example how the 
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Figure 9.1 Response latencies as a function of ease or difficulty of calculating 
proportions. 
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Figure 9.2 Acceptance rates as a function of ease or difficulty of calculating 
proportions. 

ease of generating a judgment induces judges to respond in a way that is in 
the interest of the actor who provides the response frame. 

Conclusions 

In summary, this chapter argues that the human tendency to accept one of 
many judgmental alternatives depends not only on their convincingness but 
also on the ease with which they can be generated, and this can be an impor¬ 
tant source of gullibility in everyday life (see also Fiedler, Chapter 7 this 
volume; Myers, Chapter 5 this volume; Unkelbach & Koch, Chapter 3 
this volume). As a consequence, offering heuristic routes affects the believa- 
bility of various outcomes and serves as a powerful means of social influence. 
Heuristics are pragmatically defined in relation to some more difficult (sys¬ 
tematic) ways of processing while the types of simplification are numerous 
and even unlimited. A psychological understanding of the ease versus diffi¬ 
culty of generating a judgment requires a deeper exploration of the underly¬ 
ing mechanisms. As a theoretical orientation, the reflective impulsive model 
was introduced. 
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Based on both this model and evidence from the domains of social influ¬ 
ence and social comparison, we have argued that other than directing peo¬ 
ple’s attention toward a favorable outcome, judgmental facilitation may be 
caused by the accessibility of an arbitrary standard and the ease of compari¬ 
son. This has been recognized as a powerful means of influence in the mar¬ 
keting domain. Beyond that, the ease of comparison deserves a more basic 
exploration as a fundamental mechanism of gullibility and social influence. 
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Introduction 

What is the role of affect in gullibility? Does mood influence the way 
we examine and evaluate more or less suspicious or doubtful informa¬ 
tion? For example, could a happy mood predispose people to be more 
trusting and credulous, and conversely, could negative mood function 
as a subconscious warning signal, producing a more cautious and criti¬ 
cal evaluation of information? We do know that Homo sapiens is a rather 
moody species (Forgas & Eich, 2013), and credulity is also a fundamental 
characteristic of humankind (see also Baumeister, Maxwell, Thomas, & 
Vohs, Chapter 2 this volume; Cooper & Avery, Chapter 16 this vol¬ 
ume; Dunning, Chapter 12 this volume; Fiedler, Chapter 7 this volume; 
Krueger, Vogrincic-Haselbacher, & Evans, Chapter 6 this volume; Myers, 
Chapter 5 this volume). How do these two qualities, mood and gullibil¬ 
ity, interact? This chapter will review experiments indicating that mild, 
everyday moods can have a marked influence on gullibility. Most of us 
are intuitively aware that our feelings might have some influence on our 
judgments and behaviors, but the nature of this influence remains incom¬ 
pletely understood. 


Gullibility versus Skepticism 

The unique human ability to create, share, and act upon second-hand, 
fictional infomiation as real is one of the most remarkable evolutionary 
achievements of our species (Harari, 2014). Most social organisation and 
integration is based on the unique human capacity to accept and trust 
shared systems of beliefs as “real." But there is also a significant cost associ¬ 
ated with this remarkable cognitive ability to treat fiction as reality. The 
tendency to accept fiction as real is also the basis of human gullibility and 
superstition (see also Krueger et al., Chapter 6 this volume; Myers, Chapter 
5 this volume; Strack, Chapter 9 this volume). Belief in witches, magic 
potions, exorcism, and human sacrifice is now rare, but conspiracy theories, 
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pyramid schemes, alternative therapies, and miracle diets are still with us 
today (see also Douglas, Sutton, & Cichocka, Chapter 4 this volume; Myers, 
Chapter 5 this volume; van Prooijen, Chapter 17 this volume). In everyday 
life, knowing what to believe and what to reject remains a challenging cog¬ 
nitive task. Rejecting valid information as false (excessive skepticism) is just 
as dangerous as accepting invalid information as true (excessive gullibility; 
see also Mayo, Chapter 8 this volume). 


Affect and Credulity 

Affect has long been suspected as a source of irrationality and bias in 
judgments. Ever since antiquity, many great philosophers such as Plato, 
Aristotle, St. Augustine, Descartes, Pascal, Kant, and others considered 
affect to be a primitive and invasive but sovereign human faculty that can 
subvert human reason (Hilgard, 1980). As Pascal (1643/1966) argued, 
“the heart has its reasons which reason does not understand” (p. 113). 
Social theorists such as Machiavelli identified affect as a powerful sub¬ 
versive influence on effective thinking, and proposed elaborate schemes 
to exploit this human weakness for political gain (Machiavelli, 1961). 
Machiavelli anticipated much of what passes for everyday political prac¬ 
tice in autocratic countries, such as Hungary, where the Western vir¬ 
tues of democracy and its psychological foundation in rationality and 
individual autonomy have not yet taken root (Albright, 2018; Forgas, 
Kelemen, & Laszlo, 2015; see also Cooper & Avery, Chapter 16 this 
volume; Myers, Chapter 5 this volume). 

Psychologists have also often assumed that whenever emotions are 
“directly involved in action, they tend to overwhelm or subvert rational 
mental processes” (Elster, 1985, p. 379). Psychoanalytic theories were espe¬ 
cially influential in in casting affective states as “noisome, irrational agents 
in the decision-making process” (Toda, 1980, p. 133). Supporting this 
dynamic view, Feshbach and Singer (1957) found that attempts to suppress 
fear, paradoxically, increased the tendency to see “another person as fearful 
and anxious” indicating that “suppression of fear facilitates the tendency 
to project fear onto another social object” (p. 286). The recurring thread 
of irrationality and violence in human history was seen by some writers as 
evidence of a fatal flaw in the evolution of our species (Koestler, 1978), due 
to the poor structural integration between the archaic emotional and more 
rational neocortical structures of the brain. 

A contrary view, however, suggests that affect can also serve as a use¬ 
ful, and even essential input to effective social thinking (Damasio, 1994; de 
Sousa, 1987; Oatley & Jenkins, 1996). This chapter presents evidence that 
mild affective states and moods can indeed influence gullibility by regulating 
the information processing strategies people adopt. What are the psycho¬ 
logical mechanisms that might link affect to gullibility? We shall turn to this 
question next. 
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Can Mood Influence Gullibility? 

Affective experiences penetrate every aspect of our lives, and influence 
many of our cognitive and behavioral strategies (Fiedler, 2001; Forgas, 
2013; Zajonc, 1980, 2000; see also Fiedler, Chapter 7 this volume; Schwarz 
& Lee, Chapter 13 this volume). First, affective states can exert a strong 
affect-congruent influence on the valence of thinking (Forgas & Eich, 2013). 
Affective states can also regulate the kinds of information processing strategies 
people adopt in social situations (Bless, 2001; Bless & Fiedler, 2006; Fiedler, 
2001; Forgas, 1994, 2002). Surprisingly, the role of affect in gullibility has 
received insufficient prior attention. Our interest here is in mild mood states 
rather than emotions, as subconscious moods have been found to have more 
uniform, enduring, and reliable cognitive and behavioral consequences than 
is the case with intense and highly conscious and context-specific emotions 
(Forgas, 2006, 2013). 

For our purposes, we may define moods as low-intensity, diffuse, and 
relatively enduring affective states without a salient antecedent cause and 
therefore little cognitive content. In contrast, emotions are more intense, 
short-lived and usually have a definite cause and clear cognitive content 
(Forgas, 1995, 2002). There are two complementary cognitive mechanisms 
that are responsible for the infusion of mood states into thinking and judg¬ 
ments: (1) informational effects (influencing the content and valence of cog¬ 
nition), and (2) processing effects (influencing the process of cognition). 

Informational Effects 

Moods may influence gullibility versus skepticism by selectively priming 
the accessibility of positively or negatively valenced information in memory 
(Bower, 1981; Forgas, 1995). Thus positive mood should prime a more 
positive, trusting evaluation, and negative mood should prime more nega¬ 
tive and skeptical evaluations. Consistent with this affect-priming model, 
numerous studies found a mood-congruent bias in memory and social judg¬ 
ments (Bless & Fiedler, 2006; Fiedler, 2001; Forgas, 1994, 1995; Forgas, 
Bower, & Krantz, 1984; Niedenthal, Halberstadt, Margolin, & Innes-Ker, 
2000). In some cases, the prevailing mood state may also function as a direct 
heuristic cue, informing evaluative reactions to a stimulus or a situation 
(Clore, Schwarz, & Conway, 1994; Schwarz & Clore, 1983). 

Subsequent integrative theories of affect and cognition such as the affect 
infusion model (AIM; Forgas, 1995, 2002) specifically predict that affect 
congruence in thinking and judgments should be greatest when more 
open, elaborate, and constructive processing is required to perform a task. 
Most veracity and credulity judgments involve uncertainty and thus require 
such open and constructive processing (Fiedler, 2001; Forgas, 1995, 2002). 
Because credulity judgments require judges to go beyond the informa¬ 
tion given (Bond & DePaulo, 2006; Kraut, 1980; O’Sullivan, 2003), there 
should be a mood-congruent influence on gullibility. 
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Processing Effects of Mood 

In addition, moods may also influence the way information is processed 
(processing effects). Negative mood may function as a mild evolutionary 
alarm signal, triggering a more accommodative, detailed, and system¬ 
atic processing style. Positive mood in turn signals safety and familiarity, 
promoting a more heuristic, assimilative, and top-down processing style 
(Bless, 2001; Bless & Fiedler, 2006; Fiedler, 2001). Accordingly, negative 
mood should reduce credulity and facilitate the more accurate detection of 
deceptive communications (Bless & Fiedler, 2006). Consistent with such 
a mood-induced processing dichotomy, people in a negative mood think 
less heuristically and tend to use more detailed schemas, process persuasive 
messages more systematically (Bless, 2001; Forgas, 2007), rely more on 
new, external information (Fiedler, Fladung, & Hemmeter, 1987), show 
fewer judgmental errors (Forgas, 2011, 2013) and have better memory 
(Fiedler, Lachnit, Fay, & Krug, 1992; Forgas, Laham, & Vargas, 2005). 
Extrapolating from this evidence, we expect here that negative mood 
should also inhibit gullibility by promoting a more careful, accommodative 
processing style. 

In contrast, positive mood may enhance gullibility by recruiting a more 
heuristic, and assimilative thinking style (see also Fiedler, Chapter 7 this 
volume; Krueger et al., Chapter 6 this volume; Strack, Chapter 9 this vol¬ 
ume; Unkelbach & Koch, Chapter 3 this volume). We investigated these 
predictions in a series of studies, exploring mood effects on (1) bullshit 
detection, (2) the truth bias when evaluating urban myths, (3) the detection 
of verbal and nonverbal deception, and (4) gullibility in eyewitness recol¬ 
lections. Overall, we expected increased gullibility in positive mood, and 
greater skepticism in negative mood. 


Mood Effects on Bullshit Receptivity 

Perceiving Meaning Where There Is None 

Perhaps the purest form of gullibility occurs when people infer meaning 
in meaningless, randomly generated information. In a now famous hoax 
the physicist Alan Sokal submitted an intentionally meaningless text to a 
postmodernist theoretical journal to investigate whether a leading North 
American journal of postmodern cultural studies would publish an arti¬ 
cle liberally salted with nonsense if (a) it sounded good and (b) it flattered 
the editors’ ideological preconceptions (Sokal, 1996). The article was duly 
accepted and published (Sokal, 1994). When Sokal subsequently revealed 
the hoax, it became obvious that in many academic departments in the 
humanities and social sciences infested by postmodernism and meaningless 
verbiage can be easily passed off as a valuable intellectual product. A recent 
study “On the reception and detection of pseudo-profound bullshit” by 
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Pennycook, Cheyne, Barr, Koehler, and Fugelsang (2015, p. 559) nicely 
confirmed the same effect, showing that people often perceive vacuous, 
pseudo-profound “bullshit” text as potentially meaningful. 

In a recent study we examined the possibility that induced mood can 
influence bullshit receptivity (Forgas, Matovic, & Slater, 2018). We asked 
participants in a positive or negative induced mood to rate the meaningful¬ 
ness and profundity of two kinds of verbal “bullshit” text. The first kind, 
New Age “bullshit,” was taken from a spoof website randomly combining 
words from the banal pronouncements of Deepak Chopra: http://wisdom 
ofchopra.com (e.g., “Imagination is inside exponential space time events” 
and “Good health imparts reality to subtle creativity”). Another source of 
bullshit was meaningless psychological jargon constructed by randomly 
combining various psychological jargon words (Forgas, 1985). As moods 
can influence information processing strategies (Forgas, 2013), we expected 
positive mood to increase, and negative mood to reduce bullshit receptivity. 

Mood indeed had a significant influence. Those in a positive mood saw 
more “meaning” than those in the neutral and negative mood groups (see 
Figure 10.1). Gullibility was also significandy greater for New Age sen¬ 
tences than for scientific jargon terms. However, the mood x sentence type 
interaction was not significant, indicating a relatively uniform and content- 
independent mood effect on gullibility. Response times and memory data 
(recall and recognition) were also collected, and confirmed the predicted 
processing differences. Positive mood judges took less time than those in the 
neutral and negative mood conditions to produce a judgment. As expected, 
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Figure 10.1 Means and standard errors for mood effects on interpreting New 
Age and scientific nonsense sentences: participants in the positive 
mood condition were more gullible than those in the neutral and 
negative mood conditions in assessing the meaningfulness of nonsense 
sentences across both New Age and scientific content. 
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there was a trend towards an inverse correlation between response latency 
and gullibility, r( 79) = —.15, p = .169. Participants in a positive mood also 
had worse recall and recognition memory for sentence details than did those 
in the neutral and negative mood conditions. A d’ analysis confirmed that 
participants in the positive mood condition were significantly less able to 
discriminate between correct and distractor items than those in the negative 
mood condition (Bless & Fiedler, 2006). 

Paradoxically, more gullible participants were also more confident in 
their responses, r( 79) = .23, p = .036, especially in positive mood (Forgas 
& Cromer, 2004; Forgas et al., 2005). It seems that judges had little insight 
into their own biases (see also Dunning, Chapter 12 this volume). A sub¬ 
sequent mediational analysis suggested that positive mood was associated 
with greater self-confidence and ultimately, greater gullibility (Bower, 
1981; Forgas, 1995; Schwarz & Clore, 1983). Considering the response 
latency, memory, and self-confidence findings together, these results suggest 
that shorter processing latencies and less accommodative processing in posi¬ 
tive mood increased bullshit receptivity, impaired recall, but also produced 
greater self-confidence. 


Mood Effects on Visual Bullshit Receptivity 

Seeing meaning where there may be none is not limited to verbal state¬ 
ments, but may also occur when people evaluate ambiguous or indeter¬ 
minate visual information. Images showing what may appear as random 
patterns of shapes and colors may be interpreted as children’s work, com¬ 
puter generated images, or even modern art. In one recent study, we asked 
participants in public places who received a prior mood induction (remi¬ 
niscing about positive or negative life episodes) to judge the meaningfulness 
of four different examples of complex visual images. The target images were 
four abstract expressionist paintings taken from Internet sites (for example, 
by Jackson Pollock, and others; Forgas et al., 2018). 

A clear mood effect on perceiving meaning was obtained. Participants 
in a positive mood were significantly more likely to perceive meaning in 
these abstract expressionist images than were negative mood participants. 
Although these results show a clear mood effect, further work is needed 
to explore the psychological mechanisms responsible. Together with our 
earlier results showing a clear mood effect on perceiving meaning in mean¬ 
ingless verbal text, these findings suggest that there is a powerful human 
tendency to infer meaning in meaningless stimuli, and that this tendency is 
accentuated by positive, and reduced by negative mood. 

Mood Effects on the Truth Bias in Believing Urban Myths 

Much everyday information we come across such as “urban myths” are 
ambiguous, confusing, and potentially unreliable. As investigating every 
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claim is inherently impossible (Fiedler & Wanke, 2009), people often rely 
on simple heuristics such as ease of processing (fluency) to decide whether 
to believe or disbelieve new information. In one experiment we investi¬ 
gated the joint effects of ease of processing (fluency), and the affective state of the 
judge on believing the truth of a variety of urban myths (Koch & Forgas, 
2012). We expected that negative affect should reduce, and positive affect 
should increase reliance on fluency cues as a heuristic in truth judgments. 

Considerable evidence suggests that easy to process or fluent informa¬ 
tion is often more likely to be accepted as true, and disfluent information 
is more often rejected as false (Begg, Anas, & Farinacci, 1992; Reber & 
Schwarz, 1999; Unkelbach, 2006; see also Oyserman, Chapter 14 this vol¬ 
ume; Unkelbach & Koch, Chapter 3 this volume). This so-called truth effect 
(Dechene, Stahl, Hansen, & Wanke, 2009) occurs regardless of a statement’s 
content. The experience of fluency itself is determined by a variety of fac¬ 
tors, such as familiarity, frequency, or even the visual clarity of the informa¬ 
tion (see Alter & Oppenheimer, 2009; Unkelbach, Bayer, Alves, Koch, & 
Stahl, 2011). However, fluency cues can also be readily discounted when 
people “explicitly or implicidy recognize that it stems from an irrelevant 
source” (Alter & Oppenheimer, 2009, p. 231), or when a more elaborate 
and attentive processing style is adopted (Hawkins, Hoch, & Meyers-Levy, 
2001). As negative moods are expected to recruit a more vigilant processing 
style (Bless & Fiedler, 2006; Forgas, 1998, 2010, 2011), mood should be a 
significant moderator of the truth effect. 

Participants in this experiment first received a mood induction (viewed 
positive or negative film clips) and then judged the truth of 30 ambiguous 
“urban myth” type statements presented with either high or low percep¬ 
tual fluency (high or low contrastive background; see Reber, Winkielman, 
& Schwarz, 1998). The “urban myths” comprised ten neutral claims (e.g., 
“Instead of iron, horseshoe crabs have copper in their blood”), ten positively 
valenced claims (e.g., “Gelotology is the study of laughter and its beneficial 
effects on the body”), and ten negatively valenced claims (e.g., “The suicide 
rate in Nunavut is four times higher than in the rest of Canada”). Within 
each valence category, five statements, although highly obscure, were actu¬ 
ally true, and five statements were factually false. 

Fluently presented urban myths (high-contrast script) were indeed 
judged as more true than disfluent myths. However there was also a signifi¬ 
cant interaction between fluency and mood, such that negative mood actu¬ 
ally reversed this fluency effect (Figure 10.2). We also obtained some direct 
evidence for the predicted processing differences, as judges in a negative 
mood paid greater attention to and were more influenced by relevant stim¬ 
ulus features such as the level of concreteness and abstraction of the urban 
myths, unlike those in a positive mood. Thus, positive mood maintained, 
but negative mood eliminated the heuristic reliance on visual fluency as a 
subliminal truth cue when evaluating urban myths. Such affective influences 
on truth judgments may also be important in real-life truth judgments (such 
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Figure 10.2 The interactive effects of mood and fluency on truth judgments: 

positive mood maintains, and negative mood reduces reliance on 
fluency as an indicator of truth. 

Source: Adapted from Koch and Forgas (2012). 


as believing or disbelieving one’s partner) that usually occur in affect-rich 
contexts (Ciarrochi, Forgas, & Mayer, 2006). 

Mood Effects on Detecting Deception 

Believing or disbelieving social messages is another important domain of 
gullibility, and can be particularly difficult when facing intentional decep¬ 
tion by others. Detecting deception is also of practical importance in foren¬ 
sic, judicial, and investigative domains (cf. Lane & DePaulo, 1999), and such 
decisions often occur in affectively charged contexts, such as when evaluat¬ 
ing the credibility of a romantic partner, a friend, a child, or an employee. 

Past research suggests that people are often overly trusting when assess¬ 
ing truthfulness, and are not very good at detecting deception (Bond & 
DePaulo, 2006; Ekman & O’Sullivan, 1991; Levine, Park, & McComack, 
1999; see also Krueger et al., Chapter 6 this volume; Mayo, Chapter 8 this 
volume; Strack, Chapter 9 this volume). Many people hold incorrect naive 
theories about cues to deception, and focus on the wrong behaviors to 
detect lies (Fiedler, 1989; Fiedler & Walka, 1993). The confirmation bias, 
the correspondence bias, the “truth bias,” and the implicit tendency to trust 
others further compromise our detection efficacy (McComack & Parks, 
1986; O’Sullivan, 2003). 
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Several experiments now suggest that positive moods increase and neg¬ 
ative moods decrease judgmental biases such as the correspondence bias 
(Forgas, 1998). In one series of our experiments (Forgas & East, 2008a, 
2008b) we predicted that negative mood should reduce gullibility and 
increase skepticism, as dysphoric individuals should form less positive and 
optimistic inferences about the veracity of social messages and should be 
better at detecting deception (Forgas, 1995, 2002; Forgas et al., 1984). 

In one study (Forgas & East, 2008a), participants viewed mood-inducing 
films, and then watched video clips of males and females who were either 
truthful or deceptive in denying an alleged theft, and judged the target’s 
guilt or innocence, and their truthfulness. Elalf the targets were truthful 
in denying the theft, and half were deceitful. They were motivated to be 
convincing by the promise of free movie tickets if their denials are believed 
(whether their denials were true or not). The mood manipulation was suc¬ 
cessful, and as expected, mood did have a significant effect on judgments of 
guilt. Negative mood participants made more guilty judgments than happy 
or neutral judges (see Figure 10.3). 

Interestingly, there was also a significant interaction between mood and 
deceptiveness. Mood effects on guilt judgments were greater when targets 
were deceptive rather than truthful (Figure 10.3). Those in a negative mood 

0.9 n 
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Figure 10.3 The effects of mood and the target’s veracity (truthful, deceptive) on 
judgments of guilt of targets accused of committing a theft (average 
proportion of targets judged guilty in each condition. 

Source: Adapted from Forgas and East (2008a). 
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correctly formed more guilty judgments of deceptive (guilty) rather than 
honest (innocent) targets, while those in a happy and neutral mood were 
more credulous and less able to discriminate between innocent and guilty 
targets. Overall, detection of deception rates were significantly better than 
chance only by those in negative mood, whereas neutral and happy mood 
participants did not detect guilt above chance level. 

A follow-up signal detection analysis confirmed that negative mood 
actually improved detection accuracy compared to neutral or happy judges 
(d’ = 1.15, vs. .64, vs. .81, respectively), and also produced a higher overall 
skeptical, conservative bias (C = .53, .35, .22, respectively). In other words, 
negative mood has a dual effect on credulity, increasing accuracy and dis¬ 
crimination, and also producing a stricter and more conservative criterion 
for acceptance. Honesty ratings showed a similar pattern. Truthful targets 
were rated as more honest than deceptive targets in negative rather than 
positive mood. 


Mood Effects on Nonverbal Credulity 

Gullibility and credulity are also important when deciding whether non¬ 
verbal signals such as facial displays (by a partner, a child, or a manager) 
are genuine or deceptive (Jones, 1964). Facial expressions serve important 
interpersonal functions, as reliable cross-cultural signals indicating emo¬ 
tions, attitudes, and motivational states (Darwin, 1872; Ekman, Friesen, & 
Ellsworth, 1972). As facial expressions may be easily faked, differentiating 
between honest and deceptive displays is difficult and usually performed at 
a level only slightly above chance (Bond & DePaulo, 2006; Kraut, 1980; 
Levine et al., 1999). 

Nonverbal credulity is also subject to various contextual influences 
(McCornack & Parks, 1986), such as the correspondence bias (DePaulo, 
1992), and also the possibility of mood effects (Schiffenbauer, 1974). Poor 
ability to decode facial signals seems associated with depression and relation¬ 
ship problems (Bouhuys, Geerts, Mersch, &Jenner, 1996; Carton, Kessler, 
& Pape, 1999). 

One relevant experiment by Forgas and East (2008b) examined if happy 
mood could promote, and negative mood inhibit gullibility when evalu¬ 
ating nonverbal displays. Participants first received a false-feedback mood 
induction (being told that they have done well or badly on an anagram 
task), and then rated the genuineness of positive, neutral, and negative facial 
expressions by professional actors. Mood did influence nonverbal credulity, 
as judges in a positive mood were more likely to accept facial expressions 
as genuine and were more confident than those in the negative condition 
(see Figure 10.4). 

Subsequendy, using a similar procedure, we also looked at mood effects 
on believing highly specific emotional displays (Darwin, 1872; Ekman & 
Friesen, 1974). Happy and sad participants viewed six photographs showing 
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Figure 10.4 The effects of mood on the perceived genuineness of positive, neutral, 
and negative facial expressions: positive mood increases, and negative 
mood reduces credulity. 

Source: Adapted from Forgas and East (2008b). 


actors displaying the basic emotions of happiness, anger, sadness, disgust, 
surprise, and fear. Judges were asked to identify the emotion communicated 
and also assess its veracity. Mood again had a significant main effect on gul¬ 
libility as negative mood reduced credulity across all emotional expressions. 
These results show that negative mood can significantly reduce nonverbal 
gullibility across all expressions studied, suggesting that this is robust effect 
that may occur in real-life situations where the identification of deceptive 
expressions is of considerable importance (Ciarrochi et al., 2006). 

Mood Effects on Eyewitness Gullibility 

Affect-induced differences in processing style may also have major implica¬ 
tions for gullibility in eyewitness recall (see also Schwarz & Lee, Chapter 13 
this volume). It is well established that eyewitness memories are easily 
contaminated by misleading information received after the target event, a 
form of fake memory gullibility (Loftus & Hoffman, 1989). A series of our 
studies (Forgas et al., 2005) investigated the effects of positive and negative 
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mood on eyewitness gullibility, that is, the extent to which eyewitnesses 
incorporated later, misleading information into their recall of a target 
event. We did find that negative mood participants were less likely to 
incorporate later, misleading information into their recall of the details of 
complex scenes they witnessed (such as a car crash scene). In fact, negative 
mood almost completely eliminated the familiar “misinformation effect” 
(Loftus & Hoffman, 1989). 

In another of this series of experiments, students in a lecture hall wit¬ 
nessed a staged incident between a lecturer and a female intruder. A week 
later, they received misleading information about the altercation embedded 
in questions about the encounter when in a negative or positive mood state 
(e.g., “Did you see the intruder in the brown coat?” - when in fact she was 
wearing a black coat). When the accuracy of their eyewitness memory was 
subsequently tested, negative mood almost completely eliminated eyewit¬ 
ness gullibility and the incorrect infusion of planted, misleading details into 
recall and recognition memory. A signal detection analysis confirmed that 
negative mood significandy improved eyewitnesses’ ability to discriminate 
between correct and misleading, fake memory details (Figure 10.5). 

It was surprising that eyewitnesses in such situations had no internal 
awareness of their mood-induced biases, and explicit instructions were inef¬ 
fective to control them (Forgas et al., 2005). This pattern that is conceptually 
consistent with Dunning’s (Chapter 12 this volume) work on self-gullibility. 


False Alarms 



0 Leading 
□ Non-Leading 


Figure 10.5 Mood effects on eyewitness gullibility: Experiencing negative mood 
when receiving misleading information reduces eyewitness distortions 
compared to neutral or positive mood participants. 

Source: Adapted from Forgas et al. (2005). 
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These experiments offer convergent evidence that negative moods can have 
significant adaptive effects on memory by reducing eyewitness gullibility 
and vulnerability to misleading information, consistent with negative moods 
promoting a more focused, accommodative processing style. 

Discussion 

Deciding what to believe and who to trust is one of the most difficult and 
cognitively demanding tasks we all face in everyday life. These results provide 
clear evidence that transient mood can influence the level of gullibility or 
skepticism in many social situations. These experiments show that negative 
mood reduces bullshit receptivity, decreases the truth bias when evaluating 
urban myths, improves the ability to detect deception, and reduces eyewit¬ 
ness gullibility. These findings broadly support our hypothesis that positive 
and negative moods trigger different information processing strategies (Bless 
& Fiedler, 2006). Mood also had a significant influence on people’s accuracy 
at complex inferential tasks such as detecting deception. We found that peo¬ 
ple in a negative mood were better able than people in a positive or neutral 
mood to accurately identify lies. These results have some promising theoreti¬ 
cal and practical implications for understanding the influence of mood on 
everyday social judgments in general, and gullibility in particular. 


Theoretical Implications 

The evidence reviewed here extends previous work on mood effects on 
social cognition in general, and impression formation in particular (Forgas 
& Bower, 1987; Forgas et al., 1984) to the new domain of gullibility versus 
skepticism. Veracity judgments represent a particularly demanding cognitive 
task that requires highly constructive processing (Forgas, 1995, 2002). It is 
just these kinds of open and indeterminate judgments that have been found 
to be particularly subject to mood-induced biases in the past (Fiedler, 2001; 
Forgas, 1994, 1995; Sedikides, 1995). Recent affect-cognition research 
suggests that negative affect functions like a mild, evolutionary warning 
signal, generally contributes to a more accommodative, cautious, and atten¬ 
tive processing style, and also promotes the selective priming and greater 
accessibility of negative information in memory. Positive moods, on the 
other hand, signal familiarity and safety and tend to produce a more benign, 
confident, and optimistic interpretation of complex social information, and 
reduced levels of suspiciousness (Forgas, 1999, 2002). 

These results are also theoretically and empirically consistent with a grow¬ 
ing body of literature highlighting the apparently beneficial and functional 
processing effects of negative mood in a variety of social cognitive tasks (Bless, 
2001; Bless & Fiedler, 2006; Fiedler, 2001). In addition to priming negative 
information and increasing overall skepticism, negative affect also produced a 
specific advantage in sensitivity to detect fake, false, or misleading information 
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and deception. These cognitive benefits confirm other evidence documenting 
the adaptive effects of negative affect in reducing some heuristic judgmental 
errors such as primacy and salience effects, and also improving the efficacy of 
strategic communications such as formulating persuasive messages (Forgas, 
1998, 2007, 2011, 2013; Forgas et al„ 2005). 


Practical Implications 

Given the human propensity to believe rather than disbelieve (see also 
Cooper & Avery, Chapter 16 this volume; Dunning, Chapter 12 this vol¬ 
ume; Fiedler, Chapter 7 this volume; Myers, Chapter 5 this volume; Krueger 
et al., Chapter 6 this volume; Strack, Chapter 9 this volume), reducing gul¬ 
libility in everyday social judgments is obviously highly desirable. Many 
professionals in the persuasion business, such as advertisers, salesmen, and 
politicians are implicitly aware that putting recipients into a positive mood 
is likely to promote credulity and the subsequent acceptance of mislead¬ 
ing or manipulative claims. The present series of experiments provide clear 
empirical support for this intuitive belief. However, the empirical evidence 
also holds out some hope that more critical thinking, a greater focus on con¬ 
crete details, and general skepticism can also be increased as a result of mild 
negative mood states. The ability to correctly discriminate between truths 
and lies and so avoid gullibility is of crucial importance in both of our per¬ 
sonal and professional lives. The present demonstration of a mood effect on 
gullibility versus skepticism has some interesting practical implications for 
improving affective intelligence in everyday life, and could be incorporated 
in the training of applied professionals (Ciarrochi et al., 2006). 

These findings may also help to focus attention on the beneficial but 
counterintuitive effects of negative mood and the possible undesirable con¬ 
sequences of positive mood in some real-life circumstances. There has been 
much emphasis on the various benefits of positive mood in the recent litera¬ 
ture in clinical, organizational, counselling, and health psychology (Ciarrochi 
et al., 2006). Happy people are often thought to be more creative, flexible, 
motivated, and effective on a number of tasks (Forgas & George, 2001). Our 
findings, together with a growing number of recent experimental studies, 
suggest that positive affect may not be universally desirable. Several studies 
now show that people in a good mood are more likely to commit judgmen¬ 
tal mistakes (Forgas, 1998, 2011, 2013), are more prone to eyewitness errors 
(Forgas et al., 2005), and are less effective persuaders (Forgas, 2007). To this 
list we may now add another important caveat: People in a positive mood 
may also be generally more gullible and less able to detect deception than are 
people in negative mood. 

It is important to note that past evidence suggests that mood effects on 
cognition often depend on subtle contextual cues and the kind of process¬ 
ing strategy adopted by people in a given situation (Fiedler, 2001; Forgas, 
1995, 2002; Forgas & Eich, 2013; Sedikides, 1995). For example, mood 
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effects may be different or even absent when the deceptive communication 
is of direct personal relevance and people rely on more motivated process¬ 
ing strategies, or indeed, adopt a skeptical mindset (see Mayo, Chapter 8 
this volume). Mood effects on gullibility versus skepticism may also be 
highly sensitive to a variety of other pragmatic and situational variables 
such as the motivations, personality, and affective intelligence of the indi¬ 
vidual. For example, Lane and DePaulo (1999) found that dispositionally 
dysphoric individuals were only better at detecting specific types of lies, 
namely false reassurances, perhaps because these are the type of deceptive 
communications they are most likely to be exposed to themselves. 

Future research may well explore mood effects on skepticism and verac¬ 
ity judgments in more complex and realistic interactive situations. Even 
though considerable effort was made here to make the situations realis¬ 
tic, real-life instances of gullibility and deception may vary in a number of 
respects. Fortunately, to the extent that these results were consistent across a 
number of dependent measures and judgmental domains, and are also con¬ 
sistent with existing affect-cognition theories (Forgas, 2006, 2007), we can 
be reasonably confident that these findings are reliable. 

In addition to exploring non-specific mood effects, future studies may 
also look at the consequences of specific emotions, such as fear, disgust, 
and anger on gullibility and skepticism (e.g., Lerner & Keltner, 2001). We 
know for example that fear and disgust are typically associated with avoid¬ 
ant behaviors (see also Schwarz & Lee, this volume), whereas anger tends 
to elicit aggression. It may well be that the specific behavioral tendencies 
associated with specific emotions also have a distinct influence on the ten¬ 
dency to trust or distrust communications from others, a promising topic 
for future investigations. 

In summary, judging the veracity of social information in everyday situ¬ 
ations can be a demanding cognitive task that requires highly constructive 
processing strategies (Bond & DePaulo, 2006; Forgas, 1995, 2002). Despite 
recent advances in affect research, we still do not know enough about how 
feelings impact on cognition in general, and the degree of skepticism or gul¬ 
libility people bring to a particular task. These experiments extend recent 
research on affect and social cognition (Bower, 1981; Fiedler, 2001; Forgas, 
1995, 2002) to the new domain of gullibility and skepticism, and show that 
negative mood can increase, and positive mood decrease gullibility and 
improve their accuracy in detecting deception. These results suggest that fur¬ 
ther research on affective influences on veracity judgments and the detection 
of deception should be of considerable theoretical as well as applied interest. 
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What does it take for people to treat one coffee mug more positively than 
the next? Not much, it seems — one simply has to believe that it belongs to 
oneself. What is more, this special treatment appears to extend to everyday 
objects (such as pens, ties, and keychains) that one did not wish for, and 
neither needs, nor finds valuable. Considering something to be a personal 
belonging has been found to exert a powerful effect on cognition, influenc¬ 
ing various aspects of how one engages with the object in question and, 
more broadly, the world around oneself. For example, in comparison to 
identical items owned by or associated with someone else, people are more 
attentive to their own items, remember their characteristics better, and price 
them higher when trying to sell them (e.g., Beggan, 1992; Morewedge & 
Giblin, 2015; Symons & Johnson, 1997; Truong & Todd, 2017). 

Strikingly, it requires almost no persuasion for people to relate an object 
(or even an abstract shape) to themselves, and consequendy to exhibit 
egocentric-like predispositions in their behavior towards it. That is, the 
wide-ranging effects that ownership has on human thinking and behavior 
are indicative of a host of self-serving tendencies that influence cognitive 
processing purely based on associations with the self. In other words, a 
proportion of people’s choices, judgments, and appraisals in everyday social 
situations are guided by mosdy unnoticeable egocentric biases (see also 
Fiedler, Chapter 7 this volume; Schwarz & Lee, Chapter 13 this volume). 
Of interest is whether these biases represent the operation of a gullible mind 
or a streetwise social perceiver. We suspect the latter. 

Even though egocentrism is most pronounced in early childhood (Perner, 
1991; Wimmer & Perner, 1983), adults continue to think and behave in a 
self-centered manner. It has been suggested that in comparison to children, 
adults have stronger and more efficient corrective processes that counteract 
the effects of egocentrism (e.g., thankfully adults rarely end game nights 
because they lost a hand of poker). In other words, adults and children are 
equally self-centered, but adults are better at correcting their initial (though 
potentially reasonable) egocentric reactions (Epley & Gilovich, 2004; Epley, 
Keysar, van Boven, & Gilovich, 2004). Nevertheless, the effects of such 
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egocentric inclinations can be observed frequently in adult behavior (see 
Dunning, Chapter 12 this volume). In this chapter, we initially review how 
egocentrism impacts interpersonal communication, social interactions, and 
social perception. Interestingly, as the effects of self-centrism are already 
present much earlier in the processing stream, the influence of self-relevance 
on cognitive outcomes, such as memory and decision-making will also be 
discussed. Finally, we will present results from our laboratory suggesting 
that ownership yields a potent bias in decision-making across cultures, fur¬ 
ther indicating the apparently egocentric character of the human mind (see 
Oyserman, Chapter 14 this volume). 

Interpersonal Communication 

One instance in which people commonly give away their self-centered 
perspective is when they try to communicate with others. Put simply, indi¬ 
viduals tend to assume others know what they know, and this assumption 
guides human interactions (Nickerson, 1999). Effective communication 
requires a certain level of shared knowledge (such as a common language), 
but it is further greatly facilitated by being able to rely on widely under¬ 
stood schemas, cultural references, and common experiences. In most social 
situations, our egocentric biases can aid communication, as the majority of 
people one interacts with indeed share most of the information one has, 
and people take that for granted (Tversky & Kahneman, 1974). For exam¬ 
ple, when suggesting to determine who has to take out the trash by play¬ 
ing rock—paper—scissors, one would typically assume that the person one 
is talking to knows that they are not expected to go find a rock, a sheet of 
paper, and a pair of scissors, and more often than not, one would be cor¬ 
rect in assuming so. That being the case, relying on one’s own knowledge 
to guide one’s assumptions about how much information needs to be pre¬ 
sented (or confirmed) usually simplifies everyday interactions — it makes 
people interpersonally streetwise. 

Notwithstanding potential benefits, humans are somewhat gullible 
when it comes to estimating just how much shared knowledge they can 
refer to (Epley & Gilovich, 2006; Epley et al., 2004; Keysar, Lin, & Barr, 
2003; Tversky & Kahneman, 1974). For example, in a communication 
game, Keysar et al. (2003) demonstrated that participants were guided 
by their egocentric view, acting in ignorance of the fact that their part¬ 
ner does not have the same information that they themselves do. Further 
complicating matters, even when people become aware of a knowledge 
discrepancy, they tend to make only minor corrections to their original 
account, thereby demonstrating their credulity with regard to generalizing 
knowledge and overestimating their communal understanding. To sum 
up, relying on one’s own knowledge as a reference point for what others 
might know commonly aids interpersonal communication, serving as the 
basis for an educated guess that allows one to omit superfluous information. 
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However, on occasion, this simplification can come at the cost of accuracy 
(e.g., Epley et al., 2004; Gilovich, Medvec, & Savitsky, 2000; Gilovich, 
Savitsky, & Medvec, 1998; Keysar et al., 2003), opening the door to 
potential misunderstandings and confusion. 

Social Perception 

Beyond verbal communication, the inflated importance people assign to all 
that affects them personally gives rise to many misperceptions in their inter¬ 
actions with others (see Dunning, Chapter 12 this volume). For example, 
they tend to overestimate the extent to which others notice their appearance 
and behavior, believing that everyone around them pays a great deal of atten¬ 
tion to them (Gilovich & Savitsky, 1999). This conviction has been dubbed 
the “spotlight effect” (Gilovich et al., 2000). Consider, for a moment, what 
it would mean if the spotlight effect indeed accurately described people’s 
everyday lives. It would imply that each individual experiencing this effect 
is either the only person in their surroundings deemed worthy of height¬ 
ened attention by those around them, or that the individuals they believe are 
noticing them so much are also paying close attention to most others around 
them (which would be incredibly overwhelming). Clearly, neither interpre¬ 
tation withstands rational examination at a societal scale, yet the spodight 
effect is well documented. Students wearing an embarrassing t-shirt have, 
for instance, been found to misjudge how many people notice them, and 
individuals taking part in a group project overestimated how much attention 
their colleagues were paying to them (Gilovich et al., 2000). 

Similarly, people often overestimate how easily others detect their feel¬ 
ings and emotions (the so-called “illusion of transparency,” Gilovich & 
Savitsky, 1999; Gilovich et al., 1998). For example, Gilovich et al. (1998) 
found participants to believe that they could not successfully cover up their 
distaste for an awful drink, and that others could easily detect their lies. Both 
the spotlight effect and the illusion of transparency have been attributed to 
insufficient internal adjustment of judgments — that is, people do not take 
their internal biases into account enough when making decisions (Gilovich 
et al., 2000; Gilovich & Savitsky, 1999; Gilovich et al., 1998). In other 
words, the powerful influence of egocentric predispositions comes from 
people’s inability to escape their own particular perspective (Gilovich et al., 
2000; Gilovich & Savitsky, 1999; Gilovich et al., 1998). This suggests that 
individuals may gullibly generalize their experience of being at the center 
of their own attention to other people, effectively leading them to adopt a 
self-centered world view. While such a mindset likely does not reflect the 
reality of most interpersonal encounters, there may, however, be benefits 
to this distortion, as will be suggested at relevant points throughout this 
chapter. Interestingly, similar biases have even been found to manifest via 
associations with the self as demonstrated by the effects of egocentrism on 
people’s interactions with objects. 
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Ownership 

Object ownership has been regarded as a psychological extension of the self 
(Beggan, 1992; James, 1890), such that individuals consider their personal 
belongings (e.g., car, house, and phone) to be part of their self-concept. 
This has often served to explain why people’s appraisal of their own 
objects - compared to (otherwise equal) objects not owned by them - is 
distorted by a range of self-serving biases (Belk, 1988, 1991, 2014). For 
example, they become more attached to, and value their personal belong¬ 
ings more than identical items that are owned by somebody else. This 
is commonly referred to as the endowment effect (Kahneman, Knetsch, 
& Thaler, 1990; Knetsch & Sinden, 1984; Morewedge & Giblin, 2015). 
It suggests that the value of self-owned objects is inflated by the owner, 
compared to appraisals of identical items owned by anyone else (Maddux 
et al., 2010). For example, an individual may genuinely believe that their 
plain blue mug is worth more money than a stranger’s, their least favorite 
colleague’s, their best friend’s, and even their mother’s. 

In everyday life, the endowment effect can give rise to complications 
when owners looking to sell their items ask for higher prices than potential 
buyers find justified (Beggan, 1992; Kahneman et al., 1990; Maddux et al., 
2010; Morewedge & Giblin, 2015). This effect further appears to increase 
with time for consideration: the more time people have to decide how 
much they would be willing to buy or sell an item for, the larger the gap 
between the buyers’ and sellers’ prices (Ashby, Dickert, & Glockner, 2012). 
Similarly, experiments have shown that participants buying or selling items 
for themselves overvalue these more than when they are making such deci¬ 
sions for another person (e.g., Morewedge, Shu, Gilbert, & Wilson, 2009). 
Notably, even owning a second item that is identical to the item to be sold 
does not prevent the endowment effect (Morewedge et al., 2009), thereby 
demonstrating that, rather than being grounded in considerations of practi¬ 
cal value, the overvaluation of one’s own belongings stems from biases in 
everyday thinking. These biases, however, may reflect the streetwise char¬ 
acter of social perceivers. Feeling good about one’s belongings can make 
one feel good about oneself (Beggan, 1992). 

Even outside of economic exchanges, one can notice the effect of 
self-centered tendencies in everyday life. They can, for instance, become 
apparent when trying to clean out one’s closet: one may be motivated 
to achieve such a goal, yet it can be difficult to give up one’s personal 
belongings, even when they have not been used in years (Belk, 1988). 
Similarly, one can feel sad when an item breaks or is stolen, even when 
one considers its monetary value to be negligible (Belk, 1988). In experi¬ 
mental settings, the self-related biases associated with the endowment 
effect can be evoked simply by presenting participants with the owned 
object on a computer screen (e.g., Ashby et al., 2012) — people credu¬ 
lously adopt what they are shown only virtually, a real-life encounter is 
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not required (Turk et al., 2011). The emergence of the endowment effect 
has also successfully been demonstrated by giving participants a small gift 
at the beginning of an experiment (e.g., a pen or a mug, Kahneman et al., 
1990), and even by randomly assigning an object to the participant (the 
so-called “mere ownership effect,” Beggan, 1992; Belk, 1988, 1991). 
From this line of research, it becomes apparent that people can be effort¬ 
lessly persuaded to take ownership of an object, and immediately begin 
to display biases in their judgments. 

The ease with which these egocentric tendencies are elicited further 
indicates that the human mind can very quickly adopt new objects as part 
of the self. While this ability may at first glance be mistaken for gullibility, 
it is more likely an adaptive strategy for looking after and maintaining one’s 
possessions, which are not only representations of wealth, status, and social 
group memberships but have long played a crucial role in survival. From 
bows and arrows for hunter-gatherer societies to wallets and keys today, 
successfully attending to one’s belongings can make the difference between 
a good and a bad day. Imagine, for instance, having to read every lug¬ 
gage tag rather than being able to instantly recognize one’s own suitcase on 
an airport conveyer belt. To sum up, preferential treatment of self-owned 
objects makes us streetwise. 

Memory 

Beyond their immediate influence on judgments, egocentric biases have fur¬ 
ther been found to leave a lingering impression on human thinking. Their 
effects on memory perhaps constitute the most well-documented domain 
of self-related cognitive biases (Conway, 2005; Conway & Pleydell-Pearce, 
2000; Heatherton et al., 2006; Symons &Johnson, 1997). They are charac¬ 
terized by better recognition and recall performance for stimuli associated 
with the self, compared to associations with others and no association at 
all, and are commonly referred to as “self-reference effects” (e.g., Conway, 
2005; Macrae, Moran, Heatherton, Banfield, & Kelley, 2004; Symons & 
Johnson, 1997). Typically, this is demonstrated by asking participants to 
either process information by relating it to themselves (e.g., “Does ‘hon¬ 
est’ describe me?”), or to process it in relation to another person (e.g., 
“Does ‘honest’ describe Donald Trump?”). In an early demonstration of 
the self-reference effect, Rogers, Kuiper, and Kirker (1977) asked partici¬ 
pants to judge trait adjectives structurally, phonemically, semantically, and 
self-referentially. The incidental encoding phase was followed by a surprise 
recall test. Comparing memory performance across the different word¬ 
processing conditions, Rogers and colleagues found a significant memory 
advantage for self-referentially processed words, suggesting that relating 
information to oneself constitutes an advantage during encoding that facili¬ 
tates recall, and this holds true even when one did not expect to have to 
recall the information. 
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Beyond mere word recollections, more recent research has further 
found enhanced episodic memory for perceptual (e.g., images of objects) 
and other source information pertaining to self-referentially encoded 
items, indicating that the self-reference effect extends to non-critical, 
incidentally encoded information (e.g., Conway & Dewhurst, 1995; 
Cunningham, Turk, Macdonald, & Macrae, 2008; Leshikar, Dulas, 
& Duarte, 2015; Turk, Cunningham, & Macrae, 2008; van den Bos, 
Cunningham, Conway, & Turk, 2010). While this effect appears to not 
yet be reliably developed in children before the age of 5 (Sui & Zhu, 
2005), some studies have found a source-memory advantage for informa¬ 
tion associated with the self in even younger children (e.g., Cunningham, 
Brebner, Quinn, & Turk, 2014; Ross, Anderson, & Campbell, 2011). 
The increased richness of episodic memory for self-relevant informa¬ 
tion has been attributed to increased integration, suggesting that self¬ 
representations bind together different types of information (Sui & 
Humphreys, 2015a). Again, enhanced memory for self-related material 
would indicate the operation of a streetwise mind. 

A considerable number of studies exploring the influence the self exerts 
on memory takes advantage of the ownership effects described previously, 
comparing memory performance for self-owned to other-owned objects 
(e.g., Cunningham, Brady-van den Bos, & Turk, 2011; Cunningham 
et al., 2008; Cunningham, Vergunst, Macrae, & Turk, 2013; Englert & 
Wentura, 2016; Sparks, Cunningham, & Kritikos, 2016; van den Bos 
et al., 2010). By not directly asking participants to relate information (such 
as traits) to themselves, ownership experiments can arguably shed more 
light on how egocentric biases may affect people’s memory in everyday 
contexts. Cunningham and colleagues (2008), for example, asked par¬ 
ticipants to sort items into baskets that belonged to themselves or some¬ 
body else in an ownership paradigm. Memory performance was greater 
for self-owned objects, compared to other-owned, suggesting that even 
for merely experimentally assigned objects, people’s memory appears to 
favor their own over somebody else’s (e.g., Cunningham et al., 2008; 
van den Bos et al., 2010). The observed memory advantages might be 
attributable to deeper processing of self-related information. Proponents 
of this view hold that the self serves as a potent schema, providing a rich 
set of knowledge structures associated with oneself (compared to others), 
which is readily available during information processing and encoding, 
thereby aiding memory performance (e.g., Rogers et al., 1977). Not only 
does this view fit nicely with findings of better episodic memory for self- 
referentially encoded information (e.g., van den Bos et al., 2010), but also 
with neuroimaging research that provides evidence for a distinct process¬ 
ing pathway for self-related information (e.g., trait adjectives, Heatherton 
et al., 2006). This suggests that self-referential processing offers a unique 
advantage over associations with other people (e.g., Bower & Gilligan, 
1979), and that this advantage might occur very early in the processing 
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stream (Dunning & Balcetis, 2013), thus setting the stage for subsequent 
biases in memory and even decision-making. And while memory seems to 
be exceedingly easily influenced by self-related information, again mak¬ 
ing it appear rather gullible, remembering what is directly relevant to the 
self especially well likely facilitates everyday life, as anyone who has ever 
misplaced their keys will know. 


Decision-Making 

Recent evidence shows that humans are faster and more accurate when 
making decisions that are relevant to themselves, compared to non- 
self-relevant decisions (Humphreys & Sui, 2015; Sui, He, & Humphreys, 2012; 
Sui & Humphreys, 2015a). This finding, called the “self-prioritization 
effect,” has been investigated with a perceptual matching paradigm, in 
which participants learn pairings of shapes (e.g., triangle, circle, square) and 
labels (e.g., self, friend, stranger), and are subsequently asked to indicate 
whether the presented shape—label pairings match or mismatch the previ¬ 
ously learned associations (Humphreys & Sui, 2015, 2016; Sui et al., 2012; 
Sui & Humphreys, 2015a). These experiments show that shapes associated 
with the self are processed more efficiently (i.e., faster response times and 
higher accuracy) than shapes associated with other labels (e.g., friend, stran¬ 
ger, Sui et al., 2012), indicating that people’s impressionable minds readily 
accept such abstract associations. It has been suggested by proponents of the 
self-related integrative processing framework that self-relevance provides a 
form of associative “glue” for perception, memory, and decision-making, 
which, depending on the task context, can either facilitate or disrupt per¬ 
formance (Sui & Humphreys, 2015a). In other words, the self acts as a 
central mechanism in information processing. Notwithstanding the accu¬ 
mulated evidence in favor of self-prioritization, exactly how the self exerts 
its influence on decision-making is largely unknown. 

Many decisions are driven by uncontrollable factors favoring one 
response over another. Consider, for example, trying to pick a sandwich to 
buy for lunch. It would take no time to choose one’s regular option com¬ 
pared to a new one. Similarly, one might be quicker to pick a sandwich that 
is displayed at the counter (i.e., a more visually noticeable option), rather 
than choosing from the cafeteria’s menu. In other words, people might 
have a predisposed preference for more familiar, frequent options, or they 
might be persuaded by the relative saliency and ease of one option com¬ 
pared to another (see Strack, Chapter 9 this volume). Similarly, on a daily 
basis individuals are unnoticeably swayed in expressing rapid judgments that 
are in fact underpinned by underlying biases in decision-making (White & 
Poldrack, 2014). 

Bias is an essential component of decision-making and can provide use¬ 
ful information about cognition and its underlying processes (White & 
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Poldrack, 2014). Specifically, there are two different ways in which biased 
responding can occur. These refer to how a stimulus is processed and how a 
response is generated, respectively. Whereas variation in stimulus processing 
affects the evidence that is extracted from the item under consideration (i.e., 
stimulus bias), adjustments in response preparation influence how much 
evidence is required before a specific judgment is made (i.e., response bias). 
Having a priori knowledge allows one to make adjustments for the response 
one is going to make, such that, returning to the previous example, less 
evidence and time is required to order the more regular sandwich option. 
Contrastingly, in the absence of prior information, one might rely on the 
most salient information (e.g., sandwiches behind the counter), such that 
one’s decision would be based on an evaluation of appearance. Each of these 
biases reflects a distinct underlying cognitive component and differentiating 
them has important theoretical implications for understanding decisional 
processing (White & Poldrack, 2014). 

One way to differentiate stimulus and response biases in experimental 
settings is through application of the drift diffusion model of decision¬ 
making (Ratcliff, 1978). In the context of binary decision-making, this 
model describes decisions unfolding over time and assumes that informa¬ 
tion is continuously gathered until sufficient evidence has been acquired 
to initiate a response. In other words, individuals accumulate evidence 
over time until they reach one of the response thresholds. For exam¬ 
ple, one could continuously gather information about a pen presented 
to oneself until one either reaches the threshold for the decision that 
the pen belongs to oneself, or until one has sufficient evidence to decide 
that it belongs to someone else. Pertinent to the current enquiry, deci¬ 
sional processes can be biased in two different ways. Self could bias the 
speed and quality of information acquisition from the stimulus, such that 
one would, for example, be faster at processing the incoming sensory 
information from one’s own personal belonging, compared to somebody 
else’s. This would be interpreted as a measure of processing efficiency 
during decision-making (White & Poldrack, 2014). Alternatively, or 
additionally, response options related to the self could benefit from an 
a priori bias when making relevant decisions, such that self-biases could 
lead one to start the evidence accumulation process closer to the self- 
related (e.g., object is mine) than other-related response option (White 
& Poldrack, 2014). Put simply, it would take less information for one 
to identify and respond to one’s own pen (compared to somebody else’s 
pen), in the same way that one does not need much convincing to pick 
one’s usual sandwich option. 

Drift diffusion modeling can be informative of how exactly the self 
influences people’s thinking and behavior (i.e., how the mind is gulli¬ 
ble or streetwise with regards to the self), as it has the capacity to sepa¬ 
rate stimulus and response-related biases during decision-making (Voss, 
Rothermund, & Brandtstadter, 2008). In other words, this type of analysis 
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offers an identification of the processes underpinning speeded self-related 
responses (e.g., self-prioritization effect), thereby providing valuable new 
insight into the existing literature on how self-relevance impacts think¬ 
ing and doing. Specifically, if the mind is streetwise, what form does this 
streetwise processing take? 

Self-Ownership Effect 

To date, most demonstrations of the self-prioritization effect have relied on 
geometric shapes that serve as a proxy for the self (e.g., Sui et al., 2012; Sui, 
Liu, Mevorach, & Humphreys, 2013). Although this approach is experimen¬ 
tally expedient, it is notably removed from everyday social-cognitive func¬ 
tioning. This then raises the question of whether self-prioritization extends 
to more naturalistic processing conditions, such as objects associated with the 
self through ownership. On a daily basis, people interact with objects (e.g., 
mobile phones, clothes, pens) that belong to them or somebody else. Thus, 
interaction with a complex environment may benefit from enhanced item 
classification and recognition based on personal significance (e.g., owned by 
self vs. other). In other words, decision-making might be facilitated for per¬ 
sonally owned objects, compared to identical items belonging to someone 
else (Ashby et al., 2012; Cunningham et al., 2008). 

Evidence from our laboratory has illuminated the effects of self-ownership 
during decision-making (Golubickis, Falben, Cunningham, & Macrae, 
2018). Specifically, in a modified ownership task (Cunningham et al., 2008), 
participants were presented with items (pencils or pens) that were randomly 
assigned to — that is, owned by —either the self or a non-intimate other (a 
stranger). Their task was simply to classify the objects as either their own or 
owned by a stranger as quickly and accurately as possible. The experiment 
provided evidence that, in comparison to items owned by a stranger, objects 
belonging to the self were judged more rapidly. Submitting the data to a 
drift diffusion model analysis (HDDM package, see Wiecki, Sofer, & Frank, 
2013) further revealed that task performance was underpinned by a pre¬ 
potent response bias, such that participants required less evidence to respond 
to owned-by-self (vs. owned-by-stranger) objects. In other words, during 
the ownership task, participants made adjustments in response preparation, 
hence facilitating decision-making for self-relevant material. 

In the previous experiment, decisions were made with respect to the self 
and a complete stranger, but what about judging objects that are owned 
by someone familiar, such as one’s best friend? At least in the memory 
domain, there have been a number of demonstrations that the target of 
comparison to the self can influence the magnitude of the resultant effects. 
Specifically, when the self is compared to an intimate other (e.g., parent, best 
friend) rather than a non-intimate other (e.g., stranger), the benefits of self- 
referencing are sometimes reduced (Symons &Johnson, 1997). We explored 
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this in a follow-up experiment, in which participants again performed an 
ownership task; however, this time, objects either belonged to the self or 
to the participant’s best friend. Replicating the results from our previous 
study, the analysis revealed that the objects owned by the self were judged 
more rapidly than items owned by a friend. Similarly, drift diffusion analysis 
yielded evidence that these speeded self-ownership judgments originated 
from a predisposed response bias, such that less information was necessary to 
identify the object as self-owned. 

These results not only demonstrate that self-ownership facilitates 
decision-making, regardless of whether the target of comparison is a stranger 
or one’s best friend, but also reveal that task performance is underpinned 
by a pre-potent response bias for one’s own (i.e., self-relevant) objects. 
The latter finding is particularly interesting as response preparation biases 
are often induced by some sort of pre-existing knowledge. For example, 
in binary decision-making tasks, this has been done by informing partici¬ 
pants before each trial which response outcome is more probable (Mulder, 
Wagenmakers, Ratcliff, Boekel, & Forstmann, 2012), and by manipulating 
the frequency of the appropriate responses (i.e., unequal stimulus propor¬ 
tions; Ashby, 1983). Both of these manipulations have been found to result 
in a shift of the decision-process starting point (i.e., less evidence required) 
towards the more likely judgment. In the current experiments, no such 
information was provided, yet it appears that merely acquiring arbitrary 
ownership for the objects was sufficient for participants to make adjustments 
to their response preparation. As people more readily classified items as their 
own than someone else’s based on a predisposition to selectively lower the 
respective evidence requirements, this arguably makes them more gullible 
for self-related false positives. 

Reward might be a possible explanation for the displayed preference 
for self-relevant responses. It has been shown that response bias can be 
prompted by manipulating the pay-off of one judgment over another, such 
that participants are biased towards the rewarding (vs. unrewarding) out¬ 
come (Ashby, 1983; Bogacz, Brown, Moehlis, Holmes, & Cohen, 2006; 
Diederich & Busemeyer, 2006; Simen et al., 2009; van Ravenzwaaij, 
Mulder, Tuerlinckx, & Wagenmakers, 2012; White, Ratcliff, Vasey, & 
McKoon, 2010). It has been shown that self-relevance can activate brain 
regions associated with reward (Northoff & Hayes, 2011). For example, 
Krigolson, Hassall, Balcom, and Turk (2013) provided a gambling task in 
which participants could win or lose prizes for either themselves or some¬ 
one else. The results revealed that self-relevant stimuli (i.e., items owned 
by self) as well as responses (i.e., trials on which a “self’ response is made) 
were deemed more rewarding. Interestingly, this effect occurred regardless 
of whether participants won or lost. In other words, self-relevant responses 
were inherendy rewarding, while responses unrelated to self were not, 
which might explain why humans tend to err on the side of self-owned 
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rather than other-owned responses. Additionally, the brain areas associ¬ 
ated with the self-prioritization efFect have also been linked to processing 
reward-related information, as proposed by an integrative model of self, 
namely the self-attention network (Humphreys & Sui, 2016). Overall, self¬ 
relevant material is treated as more satisfying and rewarding than other kinds 
of information (Krigolson et al., 2013; Nayakankuppam & Mishra, 2005; 
Northoff& Hayes, 2011; Sui et al., 2012; Truong, Roberts, & Todd, 2017). 
Similarly, the response bias found in our experiments might be indicative 
of a pre-existing preference for the most rewarding option (i.e., objects are 
mine), suggesting that we lean towards the self-related option because of its 
potential payoff 

A recent study aimed to further examine the relative influence of self 
and reward, respectively, on responses in a perceptual-matching task (Sui 
& Humphreys, 2015b) by assigning rewards (high vs. low) to friend- and 
stranger-associated shapes, but not to self-associated shapes. The study found 
both self and high reward to independendy influence response patterns. 
That is, despite receiving no reward, responses to self-related materials were 
advantaged relative to low-reward stimuli and did not differ from responses 
to high-reward items. It was proposed that self- and reward-based biases in 
decision-making emerge through different pathways. Notably, however, 
reward did not influence all participants equally. Specifically, participants 
who had indicated close personal distance to strangers showed weaker effects 
of self-bias and were more strongly affected by rewards, whereas the oppo¬ 
site pattern emerged for socially distant individuals (i.e., large self-advantage, 
non-significant reward effect). This finding suggests that individual differ¬ 
ences may play an important role in determining how, and to what extent, 
egocentric biases impact our perception, thinking, and decision-making. It 
stands to reason that cultural differences might also exert a moderating influ¬ 
ence on the products of self-referential processing (Markus & Kitayama, 
2010) - but is this indeed the case? 

Culture 

It has been well documented that cultural factors exert a significant influence 
on the products of self-referential processing (see Oyserman, Chapter 14 
this volume), including the ownership efFect (Markus & Kitayama, 2010; 
Sparks et al., 2016). Western cultures are believed to promote independ¬ 
ent self-construal (i.e., emphasis on the differences between self and 
others), whereas in Asian cultures, self-construal is deemed to be more 
interdependent. Here, self is thought to be interconnected with other 
people, especially family members, to a greater extent than in Western 
cultures (Markus & Kitayama, 1991). In memory, this results in an elimi¬ 
nated or even reversed self-referencing efFect among East Asians, such 
that relating stimuli to one’s mother leads to better memory performance 
than self-relevant encoding (Zhu & Zhang, 2002; Zhu, Zhang, Fan, & 
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Han, 2007). Similarly, this cultural variability has been shown to affect 
object ownership. Are people from interdependent cultures less gullible — 
or less likely — to preferentially respond to their own, newly acquired 
items? Cross-cultural research may offer answers to this question. In an 
ownership paradigm measuring memory performance, Sparks et al. (2016) 
randomly assigned objects (i.e., common shopping items) to the self, 
best friend, mother, or stranger. The Western sample displayed a typi¬ 
cal self-reference benefit (Cunningham et al., 2008; van den Bos et al., 
2010), such that items associated with the self were the most memorable, 
compared to other targets. In contrast, Asian participants showed no, or 
reversed, memorial advantages for self-relevant material, such that their 
mothers’ items were equally or more likely to be remembered than their 
own. To sum up, at least in the context of memory, cultural socialization 
yields a potent influence on self-referential processing. 

Decision-making, on the other hand, does not show such cultural 
variation of the self-prioritization effect (Humphreys & Sui, 2016; Sui 
& Humphreys, 2015a). Specifically, during a perceptual matching task, 
participants showed an advantage for self-relevant stimuli independently 
of their cultural backgrounds (Sui, Sun, Peng, & Humphreys, 2014). In 
other words, the self facilitated decision-making for both the Western and 
the Asian samples, even when the self was compared to the participant’s 
mother. This once again raises the question of whether the cross-culturally 
observed effects of egocentrism also emerge when a more ecologically valid 
ownership task is employed. Specifically, would cultural differences in self- 
construal trigger different response-time effects between Western (i.e., self 
< mother) and Asian (i.e., mother < self) participants (Sparks et al., 2016), 
or would a standard self-prioritization effect emerge regardless of culture 
(Sui et al., 2012; Sui et al., 2014)? 

To explore this, we conducted two experiments in which Asians were 
compared to Westerners in an ownership paradigm (Golubickis et al., 
in press). We acquired samples from Kuala Lumpur and Hong Kong 
(East Asia), both of which were contrasted with a separate set of par¬ 
ticipants living in Aberdeen (United Kingdom). The task was identical 
to our previous experiments; however, it had an important modification: 
Participants judged the ownership of the presented objects (i.e., pens and 
pencils) that supposedly belonged either to themselves or their mother. 
Across two experiments and cultures, a stable pattern of results emerged. 
Ownership facilitated decision-making, such that self-owned objects were 
judged faster than identical items owned by their mother for both the 
Western and Asian participants. As before, we submitted the data to drift 
diffusion modeling to explore the origins of this effect. Mirroring our 
previous experiments, the analysis revealed that decision-making was 
underpinned by a predisposed response bias, such that participants favored 
(i.e., required less evidence for) responses to self-owned items, compared 
to mother-owned, prior to the commencement of decisional processing. 
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Importantly, this bias occurred for both the Asian and Western samples, 
indicating that both quickly adopted items as their own and were prepared 
to respond to them faster due to an a priori bias. This is in line with previ¬ 
ous demonstrations that self-relevance facilitates decision-making among 
both cultural backgrounds alike (Sui et al., 2012; Sui et al., 2014), which 
suggests that humans across cultures may benefit from the effects of ego¬ 
centric biases. 

To sum up, the equivalence of stimulus-prioritization effects across cul¬ 
tures suggests that object identification is subject to egocentrism and resist¬ 
ant to cultural influence (Sui et al., 2012; Sui et al., 2014). The question of 
why cultural socialization impacts memorial benefits of self-relevant mate¬ 
rial therefore remains to be answered. Sparks et al. (2016) proposed that 
the explanation may lie in differential processing requirements posed by 
different tasks employed in investigations of the effects of egocentric biases. 
The memorial advantages associated with self-referencing are believed to 
originate from elaborative (i.e., post-perceptual) processing operations 
that enhance stimulus encoding and representation (Conway & Dewhurst, 
1995; Johnson, Hashtroudi, & Lindsay, 1993; Keenan & Baillet, 1980; 
Klein & Loftus, 1988; Rogers et al., 1977; Symons & Johnson, 1997; Turk 
et al., 2013). Culture is stipulated to influence the degree to which self 
and other overlap in memory, resulting in differences in the representation 
of person knowledge (see Ng & Lai, 2009; Wuyun et al., 2014), which 
can account for divergent effects between Western and Asian participants 
(Sparks et al., 2016). 

In contrast, decision-making tasks, such as the ones used in our experi¬ 
ments, require only low-level identification of self-owned (vs. other- 
owned) stimuli. At the basic level of analysis at which self and other are 
being differentiated, egocentric responses are likely the default product 
of perceptual processing (Northoff, 2016), leading our minds to prefer 
self-relevant stimuli. Operating in such a way, the streetwise mind is 
preferentially furnished with self-relevant (vs. other-relevant) material 
on which subsequent processing operations can be undertaken (Sui & 
Humphreys, 2017). 

Conclusion 

The present chapter examines evidence from various fields of research within 
psychology investigating how egocentrism affects cognition and behavior. 
Throughout, the effects of self-relevance on stimulus processing, judgments, 
and memories (among others) were found to occur in adults and children, 
and to be easily experimentally induced, suggesting that people’s egocentric 
tendencies may influence their everyday lives in important and diverse ways. 
Given even minimal evidence to believe something is theirs, people will 
happily (i.e., gullibly) accept this proposition and act on it, such that addi¬ 
tional processing resources are assigned towards their newly acquired personal 


Egocentrism and Information Processing 211 

belongings — they remember them better and make decisions regarding them 
faster (and more accurately) than for items they do not consider to be theirs. 
The self, therefore, appears to be acting as a central mechanism throughout 
people’s interactions with the world (Sui & Humphreys, 2015a), guiding at 
least their initial reactions in an egocentric manner. 

Despite the demonstrated scope and strength of egocentric biases, the 
question of why the human mind so readily accepts them has not yet been 
definitively answered (see Dunning, Chapter 12 this volume; Fiedler, 
Chapter 7 this volume; Oyserman, Chapter 14 this volume; Schwarz & 
Lee, Chapter 12 this volume). It has been suggested that the self plays a 
critical role in people’s ability to communicate with, and relate to, their 
environment by serving as a stable reference point, thereby constituting an 
evolutionary advantage (see Oakley & Halligan, 2017). Extending this line 
of thinking, enhanced cognition (including decision-making and memory) 
for all that is relevant to the self may contribute to successful integration in 
this complex social world by continuously updating one’s self-narrative and 
enabling important (i.e., self-relevant) decisions to be made very rapidly. 
In this view then, the self emerges as a highly efficient strategy for engag¬ 
ing with our environment, allowing individuals to prioritize what directly 
affects the basis of their social existence. 

On a societal scale, an evolutionary advantage may further emerge from 
people’s egocentric tendencies if these lead them to behave in a socially 
beneficial manner. The impression of being noticed substantially more than 
is actually the case (i.e., the spotlight effect) could, for example, make them 
behave in ways that others consider to be socially desirable, as has been sug¬ 
gested to occur when individuals believe they are being watched (although 
individual differences might moderate this phenomenon, e.g., Pfattheicher 
& Keller, 2015). Similarly, it stands to reason that assuming others cannot 
be fooled by one’s attempts to hide one’s feelings and emotions (i.e., the 
illusion of transparency) keeps one honest, which may also benefit society 
on the large scale. Taken together, this indicates that people’s self-favoring 
strategies may make them streetwise. 

While the cognitive processes that potentially underpin such a self- 
centered strategy have in the past largely been the subject of speculation, 
new analytical methods can provide tools that allow a peek into the cog¬ 
nitive “black box.” The results from recent research by Golubickis and 
colleagues (Golubickis et al., 2018; Golubickis et al., in press), which took 
advantage of these analytic advances, lend support to the notion that, at 
least during the early stages of decision-making, people are inherendy 
egocentric. Specifically, as evidenced in an a priori response bias toward 
self-relevant material, people require less evidence when responding to 
their own than other people’s things. A cross-cultural investigation further 
revealed that such a self-bias is not only found in individualistic cultures, but 
is also exhibited by members of cultures in which the self is more strongly 
construed in relation to others, indicating that across cultures, individuals’ 
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decision-making benefits from their ability to respond faster to what is 
directly relevant to them. Put simply, the self seemingly matters most to 
everyone, and this may be adaptive. 
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The age of the Internet has produced a vast democratization of knowledge. 
Far more than in any past age, crucial information can be gained easily by 
anyone interested in seeking it — often with only a few flicks of their fingers 
on a computer’s keyboard. 

Therein, however, lies the problem. If far more people can gain informa¬ 
tion without any barriers, far more people can also provide it. Regrettably, 
among those providing it are the misinformed, bad actors, people with 
vested interests, and ideological zealots, all of whom may wish to distort 
or obscure the truth (see also Cooper & Avery, Chapter 16 this volume; 
Myers, Chapter 5 this volume). Information providers need not be even 
human. Thus, when all is said and done, we now have the technology to 
send information around the world in a nanosecond, but no way to insure 
that this information is worth paying attention to. 

As such, as far as it comes to fact and expertise, the Internet has brought 
about a true age of uncertainty. As Kevin Kelley, of Wired magazine, put it, 
“Truth is no longer dictated by authorities, but is networked by peers. For 
every fact there is a counterfact” (Anderson & Rainie, 2017). In June 2017, 
a false story suggesting the founder of Ethereum had died in a car crash 
caused the company’s market value to drop by $4 billion. The United States 
National Aeronautic and Space Administration (NASA) found that it had to 
publicly deny stories that it was running a child prostitution ring on Mars 
(Flolley, 2017). The truth may be out there, but it is increasingly hidden 
behind curtains of deception, misdirection, and misinformation. 

Thus, would it not be ironic in this new age of information, where it is 
uncertain which sources to trust, that the person we need to be wary of, 
the individual who might be most likely to deceive us, the one who is most 
likely to deflect us from truth, is ourselves? 

In this chapter, I argue that the agent we are most gullible to — even 
in this brave new technological world - is ourselves, in that we often 
imbue too much faith in our own beliefs and opinions. If gullibility can be 
defined as “an unusual tendency toward being duped or taken advantage of’ 
(Greenspan, 2008, p. 2), then that tendency rises to its most unusual levels 
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when we deal with our own beliefs and opinions. People are too quick to 
believe what the self has to say and to dismiss helpful information from oth¬ 
ers. In this chapter, I document this gullibility to self, and discuss why it is 
difficult for people to recognize who to seek advice from, namely, experts 
in their midst. Finally, I talk about first steps people must take to rid them¬ 
selves of self-gullibility. 

Overbelief in Self 

Psychological research showing that people overbelieve themselves goes 
back many decades — indeed, back to the 1950s. Since that time, psycholo¬ 
gists asked people to answer questions, make judgments, or render predic¬ 
tions, and have shown that people generally overestimate the likelihood that 
their conclusions will prove accurate (for classic reviews see Lichtenstein, 
Fischhoff, & Phillips, 1982; Moore & Healy, 2008). 


Overconfidence 

This literature, known as the overconfidence or overestimation literature, 
follows a typical format. Research participants first answer a question with 
a definable answer (e.g., such as Did Shakespeare mite more than 30 plays?) 
or make a prediction (e.g., Will you pay off your credit card by the end of the 
year?) and then estimate the likelihood, up to 100%, that they will be 
right (Moore & Healy, 2008). The consistent finding is that people largely 
overestimate the chance that their conclusions will prove accurate. To be 
sure, if they are merely guessing, they seem to be aware of that fact. If 
they think the answer to a yes-or-no question is 50:50 to be right, they 
are, indeed, accurate roughly 50% of the time (see Lichtenstein et al., 
1982; also Han & Dunning, 2018b). But on those occasions when they 
are certain of an answer, depending on the study and the topic, they are 
wrong on one out of every five answers they give (Fischhoff, Slovic, & 
Lichtenstein, 1977). 

People often show their overbelief in other ways, offering answers that 
they endorse with too much exactitude, known as the overprecision effect 
(Moore & Healy, 2008). In this form of undue self-belief, research partici¬ 
pants answer a question, such as In what year did Thomas Edison invent the 
light bulb?, and then are asked to provide a range around their answer that 
has the chance of capturing the true answer 80% of the time. For exam¬ 
ple, for Thomas Edison, they may suggest 1890 as their best guess, with the 
true answer 80% likely to be somewhere between the brackets of 1880 and 
1900 (Dunning, 2018). Or, financial officers at mid-size to large companies 
might be asked to forecast the value of the S&P 500 stock index one to ten 
years in the future, and then give upper and lower bounds that have an 80% 
chance of capturing the index’s true value at the end of the prediction period 
(Ben-David, Graham, & Harvey, 2013). 
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Work on the overprecision effect shows that people overestimate the 
exactness of their conclusions, in that the bounds they draw around their 
best guesses fail to contain the right answer as often as they think. In short, 
the truth has a habit of wandering much further away from where people’s 
intuitions think it might be located. They may draw bounds that they think 
captures the true answer 80% or 90% of the time, but those bounds actu¬ 
ally capture the truth only 35% to 40% of the time, depending on the study 
(Russo & Schoemaker, 1992). In the study of financial officers described 
above, for example, study participants drew boundaries that were too nar¬ 
row, in that they captured the true value of the S&P in the future only 37% 
of the time, not 80% (Ben-David et al., 2013). 

Importantly, this overbelief in one’s answers is the most pronounced 
among those most likely to make the most mistakes. Namely, people 
largely fail to anticipate those topics and areas in life where they are 
likely to be incompetent and provide answers that are wrong. This has 
popularly come to be known as the Dunning—Kruger effect (Dunning, 
2011; Dunning, Johnson, Ehrlinger, & Kruger, 2003; Ehrlinger, Johnson, 
Banner, Dunning, & Kruger, 2008; Kruger & Dunning, 1999), which 
formally suggests that people who lack expertise in an area suffer a dou¬ 
ble curse. First, their lack of expertise leads them to make many errors. 
Second, and more important, their lack of expertise prevents them from 
seeing their choices as errors. Put simply, they lack the very expertise 
they need to recognize just how much expertise they lack. As a conse¬ 
quence, they think they are doing just fine when, in fact, their perfor¬ 
mance suffers greatly. 

A recent example in the realm of overprecision shows this pattern. 
Research participants were asked to estimate the approximate year in 
which 12 different historical events took place, like the end of the civil war, 
Hurricane Katrina hitting New Orleans, or the stock market crashing to 
begin the Great Depression. Participants were also asked to provide bounds 
around their best estimates that would contain the true year of the event 
about 80% of the time. The top 25% of performers in the study did quite 
well. They were off in their best guess estimates by roughly seven years on 
average, but their bounds captured the right answer about 63% of the time - 
not 80% as asked but close (Dunning, 2018). 

Participants in the bottom 25% of performers, however, were off on 
average by 42 years on each and every estimate they made. To be sure, they 
had some insight into the problems of these answers, in that they provided 
bounds around those answers that were wider than those offered by the best 
performers, roughly 36 years apart rather than the confident 12 years apart 
offered by best performers. However, even these much wider bounds cap¬ 
tured the true answer only 39% of the time. In short, this unknowledgeable 
group showed some insight into the fact that their answers were impre¬ 
cise, but they largely failed to recognize just how imprecise and faulty their 
answers truly were (Dunning, 2018). 
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Belief in Wrong Answers 

In a sense, this overbelief in self should not be a surprise. It is simply the 
product of having been asked to make a choice. Facing the request, people 
choose what they think to be the best choice. They select what they believe 
to be the optimal option given all the alternatives they can think of and all 
the information and reasoning they can bring to bear (Capen, Clapp, & 
Campbell, 1971; Dunning, in press; Han & Dunning, 2018a). 

Often that choice is actually the best and all is well. However, often 
enough to cause problems, that choice can have the look and feel of a cor¬ 
rect choice but still turn out to be wrong, or at least not as good as the indi¬ 
vidual believes it to be. In auctions, this is known as the “winner’s curse,” 
in that the person who bids the most for some object at an auction is usually 
the one who is the most likely to have overvalued it (Massey & Thaler, 
2013; Thaler, 1988). This winner’s curse similarly attaches itself to people’s 
decisions. People often make the choice they overvalue. 

We have seen evidence that wrong reasoning or knowledge often leaves 
people to be just as confident, and sometimes more, as does correct reason¬ 
ing. For example, the day after the 2014 midterm elections in the United 
States, we surveyed roughly 350 respondents on their political views and 
beliefs about social and economic conditions in the country. Many of our 
questions were factual, in that true answers could be found by simple research 
over the Internet. We asked, for example, whether teenage pregnancy rates 
were at record highs, whether the stock market had gone up under the 
administration of Democratic President Barack Obama, and whether the 
poverty rate had gone down. Respondents showed only a modest aware¬ 
ness of the facts, getting on average only just over half of the questions right 
(Dunning & Roh, 2018; see also Myers, Chapter 5 this volume). 

What was interesting, however, was how participants tended to get ques¬ 
tions wrong. They had the option of saying “I don’t know” to every ques¬ 
tion, but of the items they got wrong, they chose that option only about 
35% of the time. More often than not, they gave an affirmative wrong 
answer — usually one congenial to their politics. For example, conserva¬ 
tives claimed that teenage pregnancies were at a record high (actually, no, 
they were at a 20-year low) and liberals would say that the poverty rate was 
down (at the time, it at nearly a 50-year high). As Figure 12.1 shows, on 
average, 35%—40% of what both groups claimed to be true was demonstra¬ 
bly false (Dunning & Roh, 2018). 

This, however, was the key consequence of the finding. In the survey, 
we also asked respondents if they were a “well-informed citizen.” We were 
pleased to find out positive ratings along this question were correlated with 
getting questions right. Ratings were also negatively correlated with the 
frequency with which respondents answered “I don’t know.” 

What was troubling, however, was that respondents considered themselves 
well informed to the extent they gave affirmatively wrong answers to our 
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Figure 12.1 Number of true and false facts endorsed by conservatives and liberals 
as a function of the political “lean” of the fact. 

Source: Adapted from Dunning and Roll (2018). 


questions. In fact, wrong answers stoked overall self-impressions ofbeing “well 
informed” almost as much as right answers. We have seen this pattern, as well, 
in surveys about financial literacy, civics, and world geography (Dunning & 
Roh, 2018). It is also linked to behavior. Respondents who provided more 
wrong answers to political questions also tend to be more active in politics, 
signing petitions, donating money, and organizing campaign events. 

In essence, research has found that the problem with people is that they 
often have a difficult time distinguishing true knowledge from “what they 
know that isn’t so.” In computer programming terms, they often have a 
difficult time distinguishing pattern (correct and efficient approaches to pro¬ 
gramming challenges) from anti-pattern (misleading and mistaken responses 
to such challenges) (Laplante & Nelson, 2005). Both feed into higher con¬ 
fidence (Sanchez & Dunning, 2018; van Loon, de Bruin, van Gog, & van 
Merrienboer, 2013; Williams, Dunning, & Kruger, 2013). 


Assuming Accuracy Without Feedback 

People certainly often act as though their judgments are, if not the truth, 
pretty close to it. This assumption carries implications for tasks in which peo¬ 
ple receive little or incomplete feedback. On those decisions for which people 
receive no feedback, their subsequent behavior suggests that they simply take 
their unverified judgment as correct. Their decision stands as internally gener¬ 
ated feedback, a process known as constructive coding (Elwin, Juslin, Olsson, & 
Enkvist, 2007). 

Consider, for example, a human resource official at some company who 
has final authority in making hiring decisions. That official will receive feed¬ 
back about some decisions — namely, about those applicants they ultimately 
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hired, in that those applicants either succeed or fail at the job. But what about 
rejected applicants? About them, there will be no feedback. There will be 
no chance to see how many of them, as predicted, would have failed and 
how many, despite predictions, would have succeeded. People in the human 
resource official’s position, however, will largely act as though those rejection 
decisions were all correct (Elwin, 2013; Henriksson, Elwin, &Juslin, 2010). 

The social consequences of assuming accuracy without evidence or feed¬ 
back can be profound. In one study, Fetchenhauer and Dunning (2010) 
asked college students to watch videotapes of 56 other students and to 
decide, for each, whether they would trust those people in a financial game. 
One group was given feedback about their judgments rather selectively — 
that is, only after they had decided to trust the person. Here, they could find 
out if their judgment was accurate or whether they had been too optimistic. 
However, they were not given any feedback about the other students they 
had decided were unworthy of trust. 

Participants in this condition ended up too cynical about their peers, 
significantly underestimating how trustworthy their peers would prove to 
be in the game. This is not a surprise given the biased nature of the feed¬ 
back they received plus their tendency to think of their judgments as right. 
Overly optimistic trust predictions were corrected by feedback. However, 
overly cynical predictions that led participants not to trust their peers pro¬ 
duced no feedback, and thus no opportunities to leam about misplaced 
cynicism. Participants in another group, however, who were given feed¬ 
back for each and every decision, regardless of whether they trusted or not, 
were much more accurate and optimistic about the behavior of their peers. 
They also earned more money when it came time to play the game. 

Advice 

One sees self-gullibility in what people make of the opinions and conclu¬ 
sions of others. People often discount or dismiss what other people have to 
say, usually to the detriment of the accuracy of their own self-views. People 
often tend to overbelieve in the value of their own intellect and rate their 
political and social beliefs as superior to other people (Hall & Raimi, 2018; 
Raimi & Leary, 2014; Toner, Leary, Asher, & Jongman-Sereno, 2013). 
Nearly two-thirds of Americans rate their overall intelligence as above 
average, a statistical impossibility (Heck, Simons, & Chabris, 2018). Finally, 
roughly a third of Americans view their expertise on vaccination to be at 
least as good as, if not better than, doctors and medical experts (Motta, 
Callaghan, & Sylvester, 2018). 


Discounting Advice from Others 

Although we give great weight to our own opinions and knowledge, sug¬ 
gestions from other people tend to be discounted or dismissed. The literature 
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on advice-taking, found mostly in organizational psychology, provides the 
most direct demonstration of this tendency. In a typical advise-taking study, 
people are asked to estimate, for example, the current unemployment rate, 
or the population of some city, and then are presented the estimate (i.e., 
some advice) that another person has made. They are asked, in light of any 
disagreement, whether they would like to revise their original estimate. 
Often, they decide not to, sticking with their initial intuition. Or, instead, 
they may revise their original estimate somewhat, like a little less than a 
third of the way toward the other person’s response. 

However, in the main, they typically give their own original estimate 
more weight than they do the judgment of another person, a phenomenon 
known as egocentric discounting (Bonaccio & Dalai, 2006; Harvey & Fischer, 
1997; Yaniv, 2004; Yaniv & Kleinberger, 2000). The issue with egocentric 
discounting is that people would achieve much greater accuracy if they gave 
the other person’s estimate at least just as much weight as their own - if they 
had just split the difference between the two. 

In sum, people, to their own disadvantage, often tend to give too much 
weight to their own supposed expertise than they do to the knowledge of oth¬ 
ers, doing so even if it makes sense to give the other person’s conclusions more 
weight than their own. 1 Consider Soli and Larrick (2009), who paired research 
participants with an individual from another country. Each partner was asked 
to mull over their own countries and that of their partner, and then to make 
ten estimates about each country - such as the percentage who smoked, or 
lived in urban areas, or were under 15 years of age. They then showed each 
other their estimates and asked if they wanted to revise their estimates. 

When considering their own country, respondents given the chance to 
revise their answers typically showed the usual pattern of egocentric dis¬ 
counting. They stuck to their original estimate nearly 40% of the time and 
split the difference with their partner only around 25% of the time. This 
pattern, however, is defensible, in that people presumably know more about 
their own country than their partner would. 

What was telling was how respondents reacted when looking at their part¬ 
ner’s estimates of that partner’s own country. Participants did give weight 
to their partner’s supposed expertise, but not as much as one might think, 
or as much as was warranted. Participants stuck with their original estimate 
only 10% of the time, but by far the most popular choice was to split the 
difference - that is, to give equal weight to one’s own expertise as knowl¬ 
edge from a person obviously more familiar with the country in question. 

Recent work on the Dunning—Kruger effect ratifies the observation that 
people fail to seek out expert advice as much as they should (Yan & Dunning, 
2017). In three studies, participants took quizzes in which they could win 
small amounts of money for each question they got right. For each question, 
participants were given a chance to look at the answer of another person if 
they wanted. This would diminish the amount of money they could win 
for that question, but, of course, looking at another person’s answer might 
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Figure 12.2 Confidence, accuracy, and advice-seeking rate of high and low 
performers taking a quiz on household safety issues. 

Source: Adapted from Yan and Dunning (2017). 


prevent the participant from making an error. In the first study, the topic was 
making a household safe for children. The respondents were people reporting 
having at least one child under the age of 6 at home, and were asked questions 
about preventing accidents and identifying household hazards. 

Analyses showed that participants were not very enthusiastic about 
receiving advice, asking to see another person’s response only 13% of the 
time, as shown in Figure 12.2. To be sure, participants overall asked for 
that advice on questions they were more likely to be wrong. However, 
respondents doing poorly on the quiz showed no more eagerness to receive 
advice, although they more clearly needed it, relative to participants doing 
well. As a consequence, they got many items wrong when they could have 
been alerted to their errors (Yan & Dunning, 2017). 

Not Knowing Whom to Ask 

People, however, often suffer a more fundamental problem when it comes 
to dealing with advice — left to their own devices, they do not necessarily 
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know who to approach for the best advice. In short, needing advice presents 
something of a paradox. People need advice when their own expertise con¬ 
tains gaps (Caputo & Dunning, 2005; Wu & Dunning, 2018) and defects 
(Dunning & Roh, 2018; Marsh, Cantor, & Brashier, 2016; Williams et al., 
2013). But, with those gaps and defects, how can they adequately judge the 
expertise of others to know the best one to approach? To recognize superior 
expertise would require people to already have some expertise themselves. 
However, those needing advice often simply do not have it. 

In short, those seeking advice often suffer from what we term the 
Cassandra Quandary, in that they do not necessarily have adequate exper¬ 
tise to recognize superior expertise in others (Dunning & Cone, 2018). 
As Sir Arthur Conan Doyle (1915) once observed, through his immor¬ 
tal character Sherlock Holmes, “Mediocrity knows nothing above itself’ 
(p. 25). The phenomenon is named after the princess Cassandra from Greek 
mythology and refers to what it means for the person to have superior 
expertise. Cassandra was given the gift of true prophecy, but was cursed 
by Apollo never to be believed by her peers. In essence, we suggest that 
in contemporary times, people with true knowledge often suffer the same 
fate, having their wise advice fall on deaf ears. 

We have conducted several studies showing that people have much more 
difficulty identifying people with superior knowledge than they do those 
with inferior expertise. In one study on financial literacy, participants took a 
four-item financial literacy quiz and then were asked to grade the responses 
made by four other people to the quiz. Unbeknown to participants, the 
people they graded achieved scores on the quiz that ranged from zero to 
a perfect score of four. Their specific task was to rank order their peers’ 
performances from worst to first, and asked to think explicidy about who 
they would be most likely to or least likely to approach for advice. A greater 
proportion of participants accurately identified the worst performer (43%) 
but they were far less competent in identifying the best one (29%) (Dunning 
& Cone, 2018). Of key note, shown in Figure 12.3, students doing badly on 
the quiz identified the top performer only 9% of the time. In short, those 
theoretically in most need of advice were by far the worst in identifying the 
best person to approach for advice. 

This lopsided pattern arises, in part, because of people’s gullibility to 
themselves. In short, people tend to assume their own opinions and con¬ 
clusions are true. They then use those opinions to judge those of others. If 
another person agrees with them, they often assume that the other person 
is likely to be right. If the person disagrees, then the other person is likely 
to be misguided. This tactic works well if the other person is, indeed, an 
inferior performer. However, this strategy leads to calamity when the other 
person has superior expertise. Here, a difference of opinion is read as error 
on the part of the other person when it, in fact, is error on the part of the 
self. Thus, believing in one’s own opinions often leads people to discount 
viewpoints that are superior to their own (Dunning & Cone, 2018). 
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Figure 12.3 Percentage of participants picking the right person to approach for 
financial advice (i.e., the one with the perfect score) as a function of 
the participant’s own score. 

Source: Adapted from Dunning and Cone (2018). 


One sees how this can lead to almost comical error in the domain of chess. 
In one study, we asked chess players of varying skill level to grade the moves 
made by six other chess players, whose performances ranged from terrible to 
near grand master level. Good chess players, near grand masters themselves, 
made sensible judgments about whether they could beat these other players 
after studying their moves. They were almost certain they could beat the 
player choosing terrible moves, but thought their chances were only 50:50 
with the near grandmaster. Less skilled chess players reached a different, 
somewhat paradoxical, set of conclusions: They thought their chances with 
the terrible players were close to 50:50, but that they had a 70% chance of 
beating the near grand master. Apparently, after seeing near grand master 
moves, these less skilled players mistook these unfamiliar moves to be signs 
of flawed play (Dunning & Cone, 2018). 

Differential Treatment of Self-Thought 

Up to now, one can imagine that people’s conclusions about their opin¬ 
ions and beliefs are somewhat sensible, or at least defensible, if inaccurate. 
People are given questions to answer and problems to solve, and they arrive 
at the best solution they can construct. Evolution has given humans much 
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cognitive machinery to provide answers to puzzles posed to them and 
problems that must be solved. After all, we are the species that made it to 
the moon. However, it would be unreasonable to think that this human 
machinery is completely flawless. It may be designed to help people achieve 
answers to questions they must confront, but at times the machinery might 
be “too” helpful. At times, it must prompt people to be open to certain 
beliefs that should instead be shunned. 

Thus, people tackle intellectual puzzles, and in the end they come up 
with the best solution or conclusion they can. No other solution seems 
more reasonable or superior (Dunning, in press). If any such other solu¬ 
tion had emerged in their thinking, they would have chosen that other 
one. The problem people face is that their “best options” at times are 
products of faulty reasoning (see also Fiedler, Chapter 7 this volume; 
Krueger, Vogrincic-Haselbacher, & Evans, Chapter 6 this volume; Myers, 
Chapter 5 this volume; Strack, Chapter 9 this volume Unkelbach & Koch, 
Chapter 3 this volume) or mistaken premises (Mayo, Chapter 8 this vol¬ 
ume; van Prooijen, Chapter 17 this volume). There is some glitch in their 
calculation or some crucial information is overlooked or unknown. But, 
in terms of effort and impartiality, people are trying honestly to achieve 
the best answer. Their only sin is assuming with too much certainty that 
their conclusions comprise, indeed, the best answers. 

However, that is not always the case. At times, people do short- 
circuit their thinking to arrive at conclusions that they prefer. Or, they start 
out their thinking with the premise that they are intelligent and effective 
individuals - and no fact will be admitted that questions that self-view. In 
short, people conduct their thinking under the shadow of motivated reason¬ 
ing, bending or directing their thinking in such a way to preserve favored 
pre-conceptions of the self and the world (Baumeister & Newman, 2004; 
Dunning, 2001; Kunda, 1990). Many contributors in this volume on gul¬ 
libility reasonably assume that people commit gullibility out of some func¬ 
tion or need. Gullible thinking might serve the purpose of cementing social 
relations (Baumeister, Maxwell, Thomas, & Vohs, Chapter 2 this volume), 
or assure people of their epistemological competence (Douglas, Sutton, & 
Cichocka, Chapter 4 this volume), or to manage potentially unpleasant 
emotions (Cooper & Avery, Chapter 16 this volume), or to confirm already 
decided-upon world views (van Prooijen, Chapter 17 this volume). 

Thus, it would not be a surprise to find that people treat their own 
conclusions and reasoning differently than they do that of others. People 
are motivated to believe they are trustworthy intellects, but they are not so 
sure about other people (Dunning, in press; Kunda, 1990). Thus, they tend 
to place the reasoning of other people under closer scrutiny and skepticism 
than they do their own. For example, Gregg, Mahadevan, and Sedikides 
(2017) asked people to evaluate a novel theory about an alien planet. More 
specifically, they were asked to consider two species on that planet, the 
Niffites and the Luupites, and judge which was the predator and which was 
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the prey. Before they began, however, they were given a specific theory to 
test, and told that it had been assigned to them. It was their theory; they 
were to be identified with it. Other participants were told that the theory 
came from some other participant named “Alex.” 

The researchers found, as participants pored over information testing the 
theory, that people gave more lenient ratings to the information when it 
was supposedly consistent with their own theory than when it was with 
Alex’s. As a consequence, at the end of the study, they believed in the the¬ 
ory they had been assigned to more. In a second study, they believed their 
own theory more than one that had been assigned to no one. 

Other research suggests that this bias toward one’s own theory may come 
from a superior sense that one is impartial and insightful. Namely, peo¬ 
ple tend to think of themselves as superior to other people along desir¬ 
able traits, such as honesty, intelligence, and being a good driver (Dunning, 
2005; Dunning, Heath, & Suls, 2004). Even prisoners locked up in British 
cells tend to describe themselves as more moral and ethical than the typical 
British citizens (Sedikides, Meek, Alicke, & Taylor, 2014). This sense of 
self-superiority also carries over to intellectual pursuits, with people often 
claiming better ability at reaching accurate and impartial judgments than 
their peers. In the ultimate irony, that is, people tend to have a bias toward 
claiming unusual abilities to reach unbiased conclusions (Pronin, Lin, & 
Ross, 2002). 

Managing Our Opinions 

What is one to do to avoid become a victim of gullibility? Take the case of 
Dr. Stephen Greenspan, who in 2008 at the age of 67 published his mag¬ 
num opus on his life’s work in psychiatry, The Annals of Gullibility, compris¬ 
ing decades of research and thought about what prompted people toward 
vulnerable gullibility, as well as how to avoid it. 

It was only two days after the publication of his book that Dr. Greenspan 
got the phone call. The financial advisor managing part of his retirement 
investments in New York had just been arrested for fraud. The advisor was 
Bernie Madoff, who ultimately would be found to have fleeced a total of 
more than $65 billion from his clients. For Dr. Greenspan, a full third of his 
retirement investments had vanished into that total, gone forever (Griffin, 
2009). 

That the person who literally wrote the book on gullibility could be 
taken in himself is a cautionary tale for all of us. Beyond that, the overall 
lesson is that gullibility often requires two perpetrators. It requires not only 
someone with an alluring tale but also a recipient who makes a too confi¬ 
dent judgment that the allurer can be trusted. We fall prey not only to the 
person with the tale, but to our own self-belief. 

As such, we should be vigilant not only about other people but also our 
own judgment. For his own part, Dr. Greenspan (2009) admitted as much. 
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In subsequent writings, he admitted that there were warning signs that he 
had dismissed. He did not take the usual cautions he took when dealing 
with a topic — high finance, in this case — that he knew nothing about. He 
had suspended all the rules of caution and due diligence he knew full well 
he should live by. 

In evaluations of evidence, it is customary to split the task into two assess¬ 
ments. One has to do with the strength of evidence; the other has to do 
with the weight the evidence should be given (Griffin & Tversky, 1992). 
Strength refers to the clarity or force with which evidence suggests one 
conclusion over all others. Weight refers to whether the evidence is sturdy, 
reliable, or credible. For example, a person on the witness stand may be ada¬ 
mant in his or her testimony (i.e., high in strength). But is it credible? The 
witness might have a reason to lie, and thus not to be given much weight. 

The psychological literature suggests that judgments tend to overempha¬ 
size the strength of the evidence while underemphasizing weight (Griffin & 
Tversky, 1992; Jiang, Muhanna, & Pick, 1996; Nelson, Bloomfield, Hales, 
& Libby, 2001; see also Fiedler, Chapter 7 this volume, who makes similar 
arguments via the notion of “metacognitive myopia”). For instance, sup¬ 
pose you hold a coin in your hand that may be biased towards either heads 
or tails. To assess the bias, you flip it four times and it comes up heads each 
time. That is strong signal of bias, but should you give it much weight? 
After all the chance are 1 in 16 that all you have just seen is a random 
fluke of heads. Most people, however, will find the signal to be convincing. 
Certainly they will think the signal is stronger than if you, say, had flipped 
the coin 15 times and it came up heads on 11 of them. The strength of this 
new signal is not as strong as before (only 80%), but it turns out it should be 
given more weight, in that the chance of obtaining this result statistically is 
lower than the one before (2% vs. 7%, respectively) if the coin were really 
fair. What it gives up in strength it more than makes up for in weight, that 
is, how sturdy the result is. 

Thus, one key to avoiding gullibility is to become more active in the 
assessment of weight. Not only should people pay attention to the stories 
being told, but should also be more adept at judging the credibility underly¬ 
ing those stories. Recent research has exactly focused on that: For example, 
researchers are actively working on media literacy classes to direct people 
to clues to help them weigh what stories they can believe on the Internet 
(Shellenbarger, 2016). 

The discussion in this chapter suggests that any analysis of weight should 
go beyond an analysis of the evidence out there to also include the self 
within. People need to ask if they are in a position to credibly weigh any 
evidence in front of them, or whether they need help. They need to ask, 
for example, whether a story involves expertise beyond their ken. Are they 
considering a familiar or unfamiliar topic (Dunning et al., 2004)? They also 
need to ask whether they have considered all possible conclusions, or like 
Dr. Greenspan, just went with their intuition in hiring their financial advisor 
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(Williams et al., 2013). They have to ask whether they might harbor any 
ulterior motives that may distort their reasoning (Baumeister & Newman, 
1994; Dunning, 2001; Kunda, 1990). 

Concluding Remarks 

The inevitable truth of modem life is that one must ultimately live under 
the shadow of potential vulnerability. As British novelist Graham Greene 
(1943) sagely noted, “It is impossible to go through life without trust,” for 
to live without it would mean “to be imprisoned in the worst cell of all, 
oneself’ (p. 43). As such, a central task for any individual is to learn how to 
trust without letting that trust slip into gullibility. What this chapter rein¬ 
forces is the notion that mastering the art of trust necessarily includes learn¬ 
ing when to trust — or to be wary of — one of the most important people in 
our lives, namely, ourselves. 
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Note 

1 To be sure, people are influenced by others, as was shown in Sherif’s original 
experiments on the auto-kinetic effect (Sherif, 1937). But here is an interesting 
question: What if Sherif had brought in two participants who had been exposed 
to differing norms about how much the light had moved in the darkness. Would 
they establish a new compromise norm or instead argue over how much the light 
had moved? After all, I always thought that dress was white and gold (BBC, 2015). 
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Suspicion is a mental state of doubt, leading us to wonder whether things 
may not be what they seem to be. Is the pricey gadget really as good as 
the sales person suggests? Did that colleague really mean it when he com¬ 
plimented us, or did he merely want to make us more receptive for the 
request that followed a few minutes later? And what about the faint smell of 
perfume on the husband’s jacket when he returned from that conference? 
Not surprisingly, many observers warned that suspicion can cloud the mind 
and undermine cooperation and social relationships (for a discussion from 
the seventeenth century, see Bacon, 1893). Others observed that suspicion 
motivates extensive information search (e.g., Fein, 1996) and (sometimes) 
sophisticated reasoning (e.g., Fein, McCloskey, & Tomlinson, 1997; Mayo, 
2015) to reduce ambiguity. These analyses usually focused on attributes of 
specific acts or attributes of the actor, the perceiver, and the nature of their 
interdependence (e.g., Deutsch, 1958; Kee & Knox, 1970) to understand 
the antecedents of suspicion. 

In contrast, everyday discourse often addresses suspicion in metaphorical 
terms that do not reference specific acts or attributes of the actor. Instead, 
perceivers may simply note that something “smells fishy” or does “not pass 
the smell test.” While such metaphorical expressions have long been con¬ 
sidered mere linguistic quirks, recent research showed that human thought 
about abstract concepts is grounded in more concrete sensory experience in 
the physical domain, as reviewed below. Building on this work, we tested 
whether incidental exposure to “smells of suspicion” is sufficient to influ¬ 
ence people’s behavior and trigger a “skeptical mindset” (see also Mayo, 
Chapter 8 this volume). This chapter summarizes what we learned. 

We first identify metaphorical links between smell and suspicion and 
place them in the context of recent research into metaphors and grounded 
cognition. Next, we show that incidental exposure to fishy smells is suffi¬ 
cient to undermine cooperation in economic trust and public good games. 
Turning to suspicion’s influence on reasoning, we further show that fishy 
smells increase the detection of misleading information and facilitate critical 
reasoning, including a more critical analysis of one’s own beliefs (see also 
Dunning, Chapter 12 this volume). We highlight how other manipulations 
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of distrust produce parallel effects, providing converging evidence for inter¬ 
preting the influence of incidental smells as a case of suspicion. The observed 
relationship between suspicion and smell is bidirectional: exposure to a fishy 
smell induces social suspicion and the induction of suspicion through social 
means, conversely, increases people’s sensitivity to metaphorically relevant 
odors. Taking a step back, we end the chapter by discussing the likely evo¬ 
lutionary basis of the smell—suspicion link and the role of incidental sensory 
experiences in the broader context of the situated, embodied, experiential, 
and pragmatic nature of human cognition. 


Smell and Suspicion 

A rapidly growing body of research highlights the role of sensory experience 
in cognition and emotion (for reviews, see Barsalou, 2008; Landau, 2017; 
Landau, Meier, & Keefer, 2010; S. W. S. Lee & Schwarz, 2014; Schwarz 
& Lee, 2019). The influences of interest are usually reflected in metaphors 
that link an abstract target concept with a more concrete source concept 
derived from sensory or bodily experience. For example, saying that a 
“warm” person discusses “weighty” matters with a “close” friend conveys 
social meanings through reference to the physical dimensions of tempera¬ 
ture, weight, and spatial distance. More important, variations in perceivers’ 
sensory experience have metaphor-consistent social effects: people perceive 
others as socially warmer after holding a warm rather than cold cup of coffee 
(Williams & Bargh, 2008a), consider the same book more important when 
its heft is increased through a concealed weight (Chandler, Reinhard, & 
Schwarz, 2012; Jostmann, Lakens, & Schubert, 2009), and experience more 
emotional distance after having marked spatially distant rather than close 
points on a Cartesian plane (Williams & Bargh, 2008b). 

One of the sensory experiences metaphorically related to the psychologi¬ 
cal state of suspicion is smell. In languages around the world, saying that 
something does not “smell right,” “has a smell,” or fails to pass a “smell test” 
conveys that one doubts whether things are what seems to meet the eye. 
Linguistic analyses of 18 languages (Soriano & Valenzuela, 2008), including 
Arabic, Chinese, English, French, German, Hungarian, and Spanish, docu¬ 
mented the smell—suspicion association in every language studied. However, 
languages differ in which odor they specify as the smell of suspicion. For 
example, in English, the smell of suspicion is “fishy,” in German it is “foul,” 
and Italians catch “a whiff” that remains unspecified. This suggests that the 
smell—suspicion link may be a universal conceptual metaphor with culture 
specific instantiations. When a smell is specified, it is the smell of decaying 
organic matter that may be used as food, suggesting that the smell—suspicion 
link is an evolved mechanism that protects against premature ingestion of 
“suspicious” material: When you bring it close to your mouth and it doesn’t 
“smell right” you better check it out more carefully — it may be something 
that should be rejected rather than ingested. 
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While this conjecture provides a plausible evolutionary account for why 
smell may be linked with suspicion, readers may wonder why this associa¬ 
tion should generalize beyond the assessment of smelly substances that one 
may eat? As observed for many subjective experiences — from bodily arousal 
(Zillman, 1978) to moods (Schwarz & Clore, 1983; see also Forgas, Chapter 
10 this volume), emotions (Schwarz, Servay, & Kumpf, 1985) and meta- 
cognitive experiences of ease or difficulty (Schwarz et al., 1991) - people 
are more sensitive to their momentary experience than to its source (for 
reviews, see Schwarz, 2012; Schwarz & Clore, 2007). Hence, they mis¬ 
read their experience as bearing on whatever they currently focus on, even 
when the experience is elicited by an unrelated influence. We assume that 
the same is true for sensory experiences of metaphorical relevance and the 
subjective response they elicit — once a smell induces suspicion, it will be 
brought to bear on the task at hand. If so, a “suspicious” smell should influ¬ 
ence one’s response to a wide range of tasks to which suspicion may be rele¬ 
vant. Most importantly, it should reduce interpersonal trust and cooperation 
and influence judgment and reasoning in ways that parallel the influence of 
other manipulations of distrust and skepticism (see also Mayo, Chapter 8 
this volume). Empirically, this is the case. 

Fishy Smells Curb Social Cooperation 

People are attuned to a wide variety of cues that signal whether to trust or 
suspect. These signals include attributes of the target person, such as reputa¬ 
tion (Burt & Knez, 1996), facial features (Zebrowitz, 1997), and nonver¬ 
bal behaviors (Bond et al., 1992); attributes of the perceiver, such as risk 
calculations (Dasgupta, 1988); and attributes of the context, such as social 
distance (Buchan & Croson, 2004), task structure (Sheppard & Sherman, 
1998), and risk of betrayal (Bohnet & Zeckhauser, 2004). These cues reli¬ 
ably influence behavior in economic games designed to test different aspects 
of social cooperation (see also Krueger, Vogrincic-Haselbacher, & Evans, 
Chapter 6 this volume). Hence, these games are a suitable tool for testing 
the influence of incidental odors. 


Trust Games: Will the Partner Reciprocate? 

One type of economic game addresses issues of reciprocation: If I do some¬ 
thing beneficial for you, will you reciprocate and do something good for 
me? In a typical game, decision-maker A receives an endowment from the 
researcher (say, $5 in quarters) and can freely decide how much of it, if any, 
he or she wants to send to decision-maker B. The researcher will increase 
any amount sent by some factor (say, a factor of 4), turning, for example, A’s 
contribution of $2 into $8. Decision-maker B can then decide how much, if 
any, of this money he or she wants to send back to decision-maker A. If A 
suspects that B may walk off with the money, A should not share anything. 
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If A trusts B to reciprocate, A should send B as much money as possible, 
turning the initial $5 into $20 after the researcher quadruples it. Of that 
sum, a “fair” partner would supposedly return more than A’s initial $5 — yet 
an unfair one may simply walk off with the full $20. Would A’s decision be 
influenced by an incidental smell? 

To test this possibility, we (S. W. S. Lee & Schwarz, 2012, study 1) had 
an experimenter spray fish oil, fart spray, or odorless water at a corner area 
in a campus building. Another experimenter, blind to the smell condition, 
approached students in the hallway and invited them to participate in a one- 
shot trust game with another “participant,” who was a confederate. Both 
players were escorted to the sprayed area. Each player received 20 quar¬ 
ters ($5) and an investment form with instructions and response space. The 
true participant was always approached first and designated as the sender, 
who could decide how much money to send. Any amount sent would be 
quadrupled in value. As shown in Figure 13.1, participants in the odorless 
condition sent $3.34 of their $5 endowment to their partner. An incidental 
fishy smell significantly reduced this sum to $2.53, a drop of about 25%. 
This effect was specific to the fishy smell condition and not observed for 
a different aversive and disgusting smell, the smell of flatulence produced 
by an (aptly named) “fart spray.” This negative influence of fishy smells on 
cooperation in one-shot trust games has been replicated by Sheaffer, Gal, 
and Pansky (2017, study 1). 


Amount of Investment 



Figure 13.1 Amount of investment in a one-shot trust game as a function of 
incidental smell in study 1. Error bars represent standard errors. 

Source: S. W. S. Lee and Schwarz (2012, study 1). 
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Public Good Games: Will the Partner Be a Free-Rider? 

Another type of economic game addresses issues of free-riding: Will the 
partner contribute his or her share to a common good or take a free ride 
and enjoy the good without making a contribution? In this type of game, 
each participant receives an endowment (say, $5 in quarters) and decides 
how much he or she wants to contribute to a common pool. The researcher 
multiplies the money in the pool by some factor (say, 1.8). Finally, the 
amount in the pool is equally divided among all players, independent of 
what they contributed. If player A suspects that the other player(s) will not 
contribute, A should simply keep the endowment. If A can assume that the 
other(s) contribute as well, all are better off the larger the pool that will be 
equally divided among them. 

Following the procedures described above, we (S. W. S. Lee & Schwarz, 
2012, study 2) tested the influence of incidental smells on cooperation in 
this game. Exposure to a fishy smell again reduced cooperation: participants 
contributed $3.86 of their endowment under neutral smell conditions, but 
only $2.65 under fishy smell conditions. Incidental exposure to a fart smell 
did not significantly affect their contribution ($3.38). 

Using a similar one-shot public good game, Sebastian, Kaufmann, and 
de la Piedad Garcia (2017) replicated the negative influence of inciden¬ 
tal fishy smells, as well as the lack of influence of fart smell, in Australia. 
They also observed that a fishy smell was sufficient to overcome the influ¬ 
ence of dispositional trust on cooperation. In their study, a measure of 
dispositional trust (taken from Yamagishi & Yamagishi, 1994) predicted 
participants’ contributions under neutral smell conditions but not under 
fishy smell conditions. 

Summary 

In combination, these studies highlight that incidental exposure to a sub¬ 
tle smell with metaphorical meaning is sufficient to elicit suspicion about 
others’ motives and trustworthiness, with adverse effects on cooperative 
behavior. The effect is not driven by the generic valence of the sensory 
experience but by its specific metaphorical associations, as the comparisons 
between fishy and farty smells indicate. 

Fishy Smells Curb Gullibility 

Suspicion is a mental state in which people “suspect” that something is 
wrong but are uncertain what it might be. They wonder how things may be 
different from what meets the eye and are likely to entertain alternative per¬ 
spectives and interpretations to assess their plausibility. Indeed, experiences 
of suspicion and distrust are associated with increased generation of alterna¬ 
tive interpretations (Fein, 1996; Schul, Bumstein, & Bardi, 1996), increased 
accessibility of opposing concepts (Schul, Mayo, & Burnstein, 2004), and 
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more divergent reasoning (Mayer & Mussweiler, 2011). While the observa¬ 
tion that fishy smells curb social cooperation is indicative of reduced trust, 
it is silent on whether incidental exposure to fishy smells also affects cogni¬ 
tive performance — after all, deciding not to part from one’s money when 
something feels wrong does not require complex reasoning. We therefore 
turned to classic reasoning tasks to test whether incidental exposure to fishy 
smells curbs gullibility and increases critical thinking. 


Identifying Misleading Information: There’s Something Fishy 
About this Question 

A key element of guarding against potential attempts to mislead us is the 
critical examination of what others have to say: Does their utterance make 
sense? May things be different from what was said? These concerns should 
prompt close attention to the details of a message to test whether something 
is wrong. Accordingly, people should be more likely to identify misleading 
information when they feel suspicious than when they do not. However, 
it is also conceivable that suspicion and the “skeptical mindset” it triggers 
foster the rejection of any information, independent of its veracity (see also 
Mayo, Chapter 8 this volume). 

A task that allows researchers to assess people’s sensitivity to mislead¬ 
ing information that is subdy embedded in a seemingly innocuous ques¬ 
tion was developed by Erickson and Mattson (1981) and became known 
as the “Moses illusion.” Participants are asked to answer trivia questions 
and informed that they may or may not encounter questions that lack a 
correct answer if taken literally. For example, the question “In which year 
did Obama fly to the moon?” presupposes something that did not happen, 
making it impossible to answer with a year. Participants are asked to mark 
those questions as ones that cannot be answered, while giving substantive 
answers to all questions that can be answered. In this paradigm, most people 
who are asked “How many animals of each kind did Moses take on the 
Ark?” answer “Two” despite being able to report that the biblical actor 
was Noah, not Moses, when direcdy asked (Erickson & Mattson, 1981). 
People fail to notice the distortion in the question because of the semantic 
overlap (Park & Reder, 2003) between Moses and Noah - both are old 
men associated with water in biblical stories. This gives the Moses question 
a feeling of familiarity or “fluency” (see also Unkelbach & Koch, Chapter 3 
this volume) that reduces the likelihood that people notice that something 
is wrong — it feels like they heard this before. 

Manipulations that make the question feel less familiar attenuate the 
Moses illusion. In general, familiar material is easier to process than novel 
material — it is easier to recognize, read, pronounce, and remember 
(Schwarz, 2004, 2015). But not everything that is easy to process is also 
familiar. Instead, the ease of processing may be due to other variables, such 
as a difficult to read print font, poor color contrast, or a hard to understand 


240 Norbert Schwarz and Spike W. S. Lee 

accent. Unfortunately, people are often more sensitive to their feelings 
than to where their feelings come from. They therefore misread ease of 
processing as bearing on what they are thinking about, even when it is 
merely due to an incidental variable, such as the print font (see also Forgas, 
Chapter 10 this volume). Hence, Song and Schwarz (2008) found that 
88% of their participants failed to notice the distortion in the Moses ques¬ 
tion when it was presented in an easy to read print font (black Arial 12), 
whereas only 53% failed to notice when it was presented in a difficult to 
read print font (grey Brush script 12). 

This experimental paradigm provides a test of the potential influence of 
fishy smells: Would an incidental fishy smell make it more likely that peo¬ 
ple notice something is wrong with Moses? To find out, we included the 
above Moses question and its likes in a questionnaire that participants com¬ 
pleted in a booth that did or did not have a fishy odor (D. S. Lee, Kim, & 
Schwarz, 2015, study 1). Participants received instructions from an experi¬ 
menter who was blind to conditions and were then assigned to an experi¬ 
mental booth in which another experimenter had attached a small piece 
of paper sprayed with fish oil (or water) under the table. As expected, an 
incidental fishy smell attenuated the Moses illusion. Whereas 83.3% of par¬ 
ticipants in the neutral smell condition failed to notice that something was 
wrong with Moses, only 58.1% failed to notice in the fishy smell condition. 
We also included an undistorted question, “Which country is famous for 
cuckoo clocks, chocolate, banks, and pocket knives?” The correct answer 
is “Switzerland” and participants’ performance on this question was unaf¬ 
fected by the smell to which they were exposed, indicating that the smell 
of suspicion elicited critical analysis rather than a general tendency to reject 
statements as misleading. 

In a different experimental paradigm, introduced by Loftus, Miller, and 
Burns (1978), misleading questions are used to implant false memories. In a 
typical study, participants see a series of slides that visually portray an event, 
for example, an accident involving a car and a pedestrian. Next, they answer 
questions about the event and some of these questions include a misleading 
proposition; for example, participants may be asked whether the car stopped 
at the stop sign, even though there was no stop sign in the scene they saw. 
After a delay, people who were asked a question that implied the presence 
of a stop sign erroneously “recognize” a stop sign as having been part of 
what they saw. This false memory effect is attenuated when participants 
are alerted that something may be wrong with the questions asked (Green, 
Flynn, & Loftus, 1982) or when a negative mood provides a more general 
problem signal (see Forgas, Chapter 10 this volume). Would a fishy smell 
similarly protect people against false memories? To find out, Sheaffer and 
her colleagues (2017, study 2) presented the misleading questions in a room 
that had been sprayed with a fishy or a pleasant smell. Next, they tested their 
participants’ recognition memory 48 hours later, in a neutral smell context. 
Those who had thought about the questions in the presence of a fishy smell 
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were now less likely to erroneously “recognize” objects that were men¬ 
tioned in the questions, but absent in the original scene. Presumably, suspi¬ 
cion at the time of reading the questions resulted in closer scrutiny, which 
reduced the impact of the misleading information. 

In combination, the Moses study (D. S. Lee et al., 2015, study 1) and 
false memory study (Sheaffer et al., 2017, study 2) converge on indicating 
that olfactory suspicion cues can curb gullibility. In the Moses study, an 
incidental fishy smell improved the identification of a misleading question 
without inducing a bias to falsely identify an undistorted question as prob¬ 
lematic. In the false memory study, an incidental fishy smell decreased the 
likelihood that elements of the question were incorporated into the mem¬ 
ory of the scene, presumably because participants noticed that something 
may be wrong with the question. Future research may fruitfully address 
whether fishy smells can also influence the impressions we form of other 
people, even when those people do not engage in any suspicious behavior. 
To date, research into suspicion effects in person perception has focused 
on conditions where suspicion is elicited by information about the target 
person (Fein, 1996; Hilton & Darley, 1991) and has largely neglected the 
potential influence of incidental suspicion. 


Thinking Critically About One’s Own Thoughts: May I Be Wrong? 

Suspicion pertains to things others do or say. Hence, the influence of olfac¬ 
tory suspicion cues may be limited to how we think about information 
presented by others, as in the above experiments. However, incidental 
influences on how we feel and think usually generalize to unrelated tasks, 
as has been observed for moods and emotions (for a review, see Schwarz 
& Clore, 2007), distrust (for reviews, see Mayo, 2015; Mayo, Chapter 8 
this volume), and a wide range of cognitive procedures (for a review, see 
Xu & Schwarz, 2018; see also Fiedler, Chapter 7 this volume; Krueger 
et al., Chapter 6 this volume; Strack, Chapter 9 this volume; Unkelbach 
& Koch, Chapter 3 this volume). Hence, the distrust elicited reasoning 
shifts observed in the preceding studies may carry over to how critically we 
examine our own thoughts. 

Wason’s (1960) classic rule discovery task lends itself to testing this pos¬ 
sibility. In this task, participants are asked to discover the rule underlying 
the number series 2—4—6. Most assume that the rule is “+2.” Next, they are 
instructed to test their assumption by generating a number series that the 
experimenter will mark as consistent or inconsistent with the correct rule. 
Following this feedback, participants can correct their hypothesis and state 
what they now think the correct rule is. 

In all published studies, people overwhelmingly rely on a positive-testing 
strategy (Klayman & Ha, 1987) and generate number series that are consist¬ 
ent with their hypothesis (e.g., 6-8-10; for a review, see Oswald & Grosjean, 
2004). The feedback they receive on these series always informs them that 
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their series is compatible with the rule. Although correct, this affirmative 
feedback does not allow them to recognize that their hypothesis is false. 
The correct rule is, somewhat sneakily, “Any increasing series of numbers.” 
Participants can only discover the correct rule when they generate at least 
some series that can falsify their own +2 hypothesis. Hence, discovery of the 
correct rule is facilitated by a negative testing strategy, aimed at disconfirma- 
tion, and impaired by a positive testing strategy, aimed at confirmation (for a 
review, see Oswald & Grosjean, 2004). 

If distrust and suspicion make people consider how things may be oth¬ 
erwise, they may facilitate a negative testing strategy and hence improve 
detection of the correct rule. Indeed, Mayo, Alfasi, and Schwarz (2014, 
study 1) observed that people who are very low in dispositional trust per¬ 
form better on this task than people high in dispositional trust. Moreover, 
experimentally inducing distrust through exposure to an untrustworthy 
face increases the prevalence of negative hypothesis testing, again result¬ 
ing in improved rule discovery (Mayo et al., 2014, study 2; see also 
Mayo, Chapter 8 this volume). Would the presence of an incidental smell 
similarly induce people to be more critical in testing their own, self¬ 
generated hypotheses? 

To find out, participants had to work on Wason’s (1960) rule discovery 
task in a cubicle that had a fishy or neutral smell (D. S. Lee et al., 2015, 
study 2). They first received their instructions from an experimenter who 
was blind to conditions and were then assigned to a cubicle that another 
experimenter had prepared with the respective smell. After generating six 
test series, participants called the experimenter and received feedback on 
their series. Finally, they reported what they now thought the rule was, 
given the feedback they received. 

The results parallel the findings of Mayo and colleagues (2014). Overall, 
all participants generated more confirmatory than disconfirmatory num¬ 
ber series, independent of smell condition. Nevertheless, smell signifi¬ 
cantly influenced whether participants made any attempt to disconfirm. 
Specifically, 47.7% (21 out of 44) of the participants assigned to the fishy 
cubicle listed at least one negative hypothesis, whereas only 27.7% (13 out 
of 47) of those assigned to the neutral smelling cubicle did so. This differ¬ 
ence in testing strategy is also reflected in the likelihood of discovering the 
correct rule. Whereas only 6.4% of the participants in the neutral smell con¬ 
dition discovered the correct rule, 20.5% in the fishy smell condition did so. 

Sebastian and colleagues (2017) replicated this result in Australia, add¬ 
ing a fart spray condition as an additional control. In their study, partici¬ 
pants exposed to an incidental fishy smell were twice as likely to generate 
at least one negative hypothesis test than participants exposed to an inci¬ 
dental fart smell. The latter condition did not significantly differ from a 
neutral smell condition, again indicating that the influence of fishy smells 
does not merely reflect their aversive or disgusting nature (S. W. S. Lee 
& Schwarz, 2012). 


The Smell of Suspicion 243 


Summary 

In combination, the reviewed studies indicate that incidental exposure to olfac¬ 
tory cues that are metaphorically related to suspicion can curb gullibility. They 
make people more likely to scrutinize information they receive from others, 
which increases the correct identification of misleading questions (D. S. Lee 
et al., 2015, study 1) and reduces the generation of false memories (Sheaffer 
et al., 2017, study 2). This more critical approach to information is not limited 
to the examination of material presented by others, but can carry over to assess¬ 
ments of one’s own thoughts. When asked to test their own, self-generated 
hypotheses, people take a more critical approach to testing when exposed to a 
smell of suspicion (D. S. Lee et al., 2015, study 2; Sebastian et al., 2017). This 
influence of olfactory cues parallels the influence of other cues that something 
may be wrong, including chronic or temporary distrust (Mayo et al., 2014) and 
low processing fluency (Song & Schwarz, 2008). 

Suspicion Increases Sensitivity to Fishy Smells 

The reviewed findings are consistent with metaphors that associate suspicion 
with smell. The representational structure of these metaphors implies a uni¬ 
directional influence from smell to suspicion. However, such unidirectional 
metaphors can nevertheless produce bidirectional associations between their 
core concepts, as we discuss in detail elsewhere (S. W. S. Lee & Schwarz, 
2012; S. W. S. Lee, 2016; see also, Ijzerman & Koole, 2011). Indeed, induc¬ 
ing social suspicion increases perceivers’ sensitivity to fishy smells without 
affecting their sensitivity to other smells. 

In several studies, we handed participants a set of test tubes containing 
fragrance oils or food substances, such as cinnamon, orange nectar, minced 
onion, and fish oil. Participants sniffed each tube and wrote down any smell 
that came to mind (S. W. S. Lee & Schwarz, 2012, studies 3a-3c). Prior to this 
task, the experimenter did or did not engage in behavior that suggested she 
may be hiding something, thus eliciting participants’ suspicion. Three variants 
of this procedure, using different combinations and intensities of pleasant and 
unpleasant smells, converged on the same conclusion: a socially induced state 
of suspicion significandy enhances the correct identification of fishy smells. 
When the fishy smell was blatant and 50% of participants identified it cor- 
recdy without suspicion, suspicion increased identification to 72.5%; when 
the smell was subtle and only 6.7% identified it without suspicion, suspicion 
increased correct identification to 33.3%. In contrast, suspicion did not signifi¬ 
candy induence the identification of any of the other smells. 

Additional research showed that suspicion selectively increases people’s abil¬ 
ity to detect subtle fishy smells presented at low levels of concentration (S. W. S. 
Lee & Schwarz, 2012, study 7). In this study, participants received 31 test flasks 
that contained either no odor or the target odor (fish oil or fart spray) at three 
different levels of concentration. They were asked to identify whether the tar¬ 
get odor was present. As shown in Figure 13.2, compared with non-suspicious 
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Concentration Level of Fish Oil 


No Suspicion - Suspicion 


Figure 13.2 Confidence ratings for smell presence as a function offish oil 

concentration with and without suspicion. Error bars represent 95% 
confidence intervals. 

Source: S. W. S. Lee and Schwarz (2012, study 7). 


participants, suspicious participants’ confidence ratings increased more sharply 
with the concentration offish oil, indicating that it increased their sensitivity to 
low levels of the odor. This was not observed for fart spray, indicating that the 
effect of suspicion is limited to metaphorically associated smells and does not 
generalize to other smells of an unpleasant nature. Equally important, suspicion 
did not increase participants’ overall confidence ratings for fish oil or fart spray, 
indicating that it did not induce a response bias. Instead, the effect was limited 
to low levels of concentration of the metaphorically related smell, document¬ 
ing increased odor specific sensory sensitivity. 

Perspectives on Gullibility 

The Situated, Experiential, Embodied, and Pragmatic Mind 

The findings we reviewed in this chapter can be discussed from the per¬ 
spective of evolutionary, cognitive, affective, and embodied theorizing. 
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It is tempting to favor one or the other to identify the “real” process 
underlying the observed bidirectional relationships between olfactory 
cues, feeling, and thinking. However, the different theoretical perspec¬ 
tives are not mutually exclusive and we conclude this chapter with a 
discussion of their interplay. 


Evolution 

That smell and suspicion are associated in different cultures and languages 
around the globe (Soriano & Valenzuela, 2008) suggests a universal meta¬ 
phorical association with culture-specific implementations. From an evolu¬ 
tionary perspective, it would be adaptive to step back and take the time for 
closer inspection when something that one may touch or ingest does not 
smell right. Indeed, a hesitant response to things that have the wrong smell 
is shared by many organisms (Herz, 2011). To be adaptive, this response 
should not be limited to the smell that is specified in the metaphors of 
one’s culture but should also be elicited by other smells that pose the same 
adaptive problem. If so, a fishy smell should elicit suspicion even when 
one’s culture that does not specify “fishy” as the smell of suspicion. The 
limited available evidence is compatible with this prediction. As noted ear¬ 
lier, Sheaffer and colleagues (2017) observed that fishy smells undermined 
cooperation in a public goods game (study 1) and attenuated the impact of 
misleading information (study 2). Importandy, they obtained these results 
with Israeli participants in studies administered in Hebrew, a language that 
does not specify “fishy” as the smell of suspicion. Future research may fruit¬ 
fully explore the influence of a broader range of odors across a broader range 
of cultures and languages. 


Metaphors 

From an evolutionary perspective, smell-suspicion metaphors are them¬ 
selves an expression of an evolved adaptive mechanism. But this does not 
preclude that the culture specific implementations of the general smell- 
suspicion metaphor can have a unique causal impact (see also Baumeister, 
Maxwell, Thomas, & Vohs, Chapter 2 this volume). Several aspects of this 
assumption are worth systematic testing. One pertains to the relative impact 
of different smells. Frequent exposure to the metaphors of one’s culture 
should strengthen the link between suspicion and the culturally specified 
smell, which should make this particular smell more influential than other 
adaptively relevant smells. We would expect, for example, that “fishy” as 
well as “foul” smells can elicit suspicion in Americans as well as Germans 
but that both respond more strongly to the smell specified in their respec¬ 
tive cultural metaphors. Unfortunately, any test of differences in the relative 
impact of different smells requires a calibration of smell intensity, which is 
a challenging task: how much of a fishy smell is equivalent to how much of 
a foul smell? 


246 Norbert Schwarz and Spike W. S. Lee 

More tractable is the influence of semantic representation. The smell 
specified by one’s cultural metaphors becomes part of one’s knowledge about 
suspicion. Hence, the general rules of knowledge accessibility apply. Indeed, 
priming English speakers with concepts of suspicion increases the accessi¬ 
bility of fish-related concepts (S. W. S. Lee & Schwarz, 2012, study 5). 
This makes them more likely, for example, to complete the letter string 

“FI_ING” with FISHING rather than FITTING, FILLING, or another 

applicable word. The increased accessibility of fish-related concepts, in turn, 
facilitates the correct identification of fishy smells (S. W. S. Lee & Schwarz, 
2012, study 6). Theoretically, semantic representations provide a cognitive 
pathway for mutual influences between concepts related to suspicion and 
concepts related to smell that are independent of a concurrent online experi¬ 
ence of suspicion. We assume that such knowledge effects are language based 
and culture specific, making it unlikely, for example, that concepts of suspi¬ 
cion would prime fish-related concepts for German participants. 


Feelings 

Smell is just one of many variables that can elicit suspicion (see Forgas, 
Chapter 10 this volume). Indeed, most research into suspicion and distrust 
has used other manipulations, ranging from memories of bad experiences 
to attributes of one’s interaction partner (Burt & Knez, 1996) and inciden¬ 
tal exposure to distrust worthy faces (Mayo et al., 2014). More important, 
such manipulations have produced results that parallel the impact of smells, 
as noted throughout this chapter (see Mayo, 2015; Mayo Chapter 8 this 
volume). These parallel effects highlight that the experience of suspicion 
is sufficient to reduce social cooperation and gullibility, independent of its 
specific induction. 

As observed in many domains, people are more sensitive to their subjec¬ 
tive experiences than to where these experiences come from. Hence, they 
misread their current feelings and fleeting thoughts as part of their response 
to whatever is in the focus of their attention. This influences the judgments 
they form and the processing strategy they choose, as conceptualized in 
feelings-as-information theory (for reviews, see Schwarz, 2012; Schwarz & 
Clore, 2007). From this perspective, incidental feelings of suspicion under¬ 
mine cooperation because they are misperceived as part of one’s response to 
the partner and the nature of the game. If participants became aware of the 
incidental nature of their feeling, its informational value would be under¬ 
mined and its influence attenuated or eliminated as has been observed for 
moods (Schwarz & Clore, 1983), emotions (Schwarz et al., 1985), bodily 
arousal (Zillman, 1978) and metacognitive experiences of ease and difficulty 
(Sanna, Schwarz, & Small, 2002). Hence, subtle smells are likely to be more 
influential than intense smells, which attract more attention and carry a 
higher risk of awareness. Because feelings are associated with semantic and 
episodic information about circumstances in which they are experienced 
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(Bower, 1981; Bower & Forgas, 2001), they also bring to mind related 
declarative information that further feeds into judgment (for a review, see 
Forgas, 2001). 

In addition to serving as input into a judgment, feelings inform people 
about the nature of the current situation. As assumed by many accounts of 
situated cognition (for a review, see Smith & Semin, 2004), thought pro¬ 
cesses are tuned to meet the requirements of the situation at hand. Feelings 
play a key role in this tuning process by providing rapidly available infor¬ 
mation about the current situation (Schwarz, 1990, 2002), usually preced¬ 
ing careful analysis (Zajonc, 1980). When distrust and suspicion signal that 
things may not be what they seem, processing is oriented towards potential 
alternative interpretations of reality (see Mayo, 2015; Mayo, Chapter 8 this 
volume). As reviewed above, this influence is sufficient to overcome one 
of the most robust biases in the psychology of reasoning, namely reliance 
on confirmatory hypothesis testing strategies (D. S. Lee et al., 2015; Mayo 
et al., 2014). 

Importantly, suspicion is not the only feeling that can reliably influence 
people’s reasoning strategies. As observed decades ago, people tend to pay 
less attention to the quality of an argument and are less likely to elaborate 
on its implications when they are in a happy rather than sad mood (Bless, 
Bohner, Schwarz, & Strack, 1990). Hence, weak arguments are more per¬ 
suasive when the audience is in a positive mood, whereas strong arguments 
are more persuasive when the audience is in a negative mood. Both effects 
reflect that recipients tend to think less about the message when they feel 
good rather than bad, leading them to miss its weak as well as strong points 
(for a review, see Schwarz, Bless, & Bohner, 1991). Particularly relevant 
in the context of gullibility is the metacognitive experience of processing 
fluency, which figures prominently in intuitive assessments of truth (for 
reviews, see Schwarz, 2018; Schwarz, Newman, & Leach, 2016; see also 
Fiedler, Chapter 7 this volume; Strack, Chapter 9 this volume; Unkelbach 
& Koch, Chapter 3 this volume). In a nutshell, people’s assessments of the 
veracity of a claim are dominated by five criteria: Is the claim compat¬ 
ible with other things I believe? Is it internally consistent? Does it come 
from a credible source? Are there many supporting arguments? Do others 
think so as well? Each of these criteria can be evaluated by drawing on rel¬ 
evant details (an effortful analytic strategy) or by attending to the ease with 
which the content can be processed (a less effortful intuitive strategy). As 
a large body of experimental research (reviewed in Schwarz, 2018) indi¬ 
cates, fluent processing provides an affirmative answer to each of these truth 
tests, even when more careful processing would identify the claim as faulty. 
Hence, any variable that increases processing fluency — from repetition (e.g., 
Hasher, Goldstein, & Toppino, 1977; Unkelbach & Koch, Chapter 3 this 
volume) and color contrast (e.g., Reber & Schwarz, 1999) to rhyme (e.g., 
McGlone & Tofighbakhsh, 2000), ease of pronunciation (e.g., Newman 
et al., 2014) and audio quality (e.g., Newman & Schwarz, 2018) - also 
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increases acceptance of the fluently processed message, whereas disfluency 
curbs acceptance of the message. 


Situated, Experiential, Embodied, and Pragmatic 

While each of these perspectives sheds light on some aspect of the reviewed 
research, it is useful to consider their interplay in the overall picture of 
human feeling and thinking. As William James (1890) emphasized, thinking 
is for doing. We do things in specific contexts and our pragmatic pursuits 
benefit from close attention to the situation at hand. This renders the abun- 
dandy observed context sensitivity of human cognition beneficial, occasional 
errors and biases notwithstanding (Schwarz, 2007, 2010; Smith & Semin, 
2004). Feelings play a key role in this process by providing fast information 
about the situation at hand, often before relevant sources can be identified 
(Zajonc, 1980). Moreover, we interact with the world through our bodies 
and experience it through our senses. This makes sensorimotor information 
important and, in evolutionary terms, ancient building blocks for knowledge 
representation and reasoning (Barsalou, 2008; Lakoff & Johnson, 1999). As 
the rapidly accumulating evidence for embodied cognition illustrates, higher 
mental processes are scaffolded onto phylogenetically and ontogenetically 
older sensorimotor processes, reflecting that evolution is largely a recycle 
and reuse enterprise (Anderson, 2010, 2014). Many of these linkages are 
reflected in conceptual metaphors (Lakoff & Johnson, 1999) that have stimu¬ 
lated extensive research into the role of sensorimotor inputs in human judg¬ 
ment and decision-making (for reviews, see Landau, 2017; S. W. S. Lee & 
Schwarz, 2014; Schwarz & Lee, 2019). The picture that emerges emphasizes 
the situated, experiential, embodied, and pragmatic nature of human cogni¬ 
tion and these features “seep” into everything we do, allowing an incidental 
fishy smell to impair social cooperation and to curb our gullibility. 
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Introduction 

People are typically not stymied by everyday life in their own culture — 
their culture provides an organizing lens so they have an implicit (“goes 
without saying”) sense of what to expect in an array of everyday situations. 
In their own culture, people have a gut sense of the way details are woven 
together (Lin, Arieli, & Oyserman, 2018; Mourey, Lam, & Oyserman, 
2015; Oyserman, 2011). They have a gut feel for the “right” food for break¬ 
fast, the “right” color for bridal dresses, the “right” colors and shapes for 
Valentine’s cards; they know the “right” tone for obituaries. In ambiguous 
situations, they know which mental procedure to use — one that focuses on 
connecting and relating or one that focuses on separating and distinguish¬ 
ing, and whether to pursue action for personally “me”-framed or socially 
“us”-framed goals (Oyserman, 2017). These often-implicit culturally rooted 
predictions are automatically and rapidly tested against observation, yielding 
either an easy-to-process prediction-observation match or a more difficult- 
to-process prediction-observation mismatch (Oyserman, 2011, 2017). The 
terms cultural fluency and cultural disfluency were coined to highlight that the 
metacognitive experience of ease (difficulty) is a result of match (mismatch) 
with culturally rooted expectations (Oyserman, 2011). Cultural fluency 
serves three functions (Oyserman & Yan, 2018): Cognitively, it signals “all 
is well,” conserving cognitive and attentional resources for the unexpected. 
Interpersonally, it reduces social friction among people sharing a cultural 
frame — all of whom experience a similar sense of fluency when situations 
unfold as expected. Intra-psychically, it provides a sense of purpose and 
meaning in life — a feeling of causal certainty. 

However, as I outline in this chapter, cultural fluency also encourages the 
kinds of social intelligence failures that leave people credulous and gullible — 
willing to believe unlikely propositions and easily tricked into ill-advised 
actions. In this chapter, I use culture-as-situated cognition theory (e.g., 
Oyserman, 2011, 2015a, 2016, 2017; Oyserman & Yan, 2018) to explain 
these paradoxical consequences, laying out the theory and its implications 
in three sections. In the first section, I briefly outline culture-as-situated 
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cognition theory. In the longer second section, I summarize the research 
examining the downstream psychological consequences of cultural fluency 
and disfluency, which focuses on a number of markers of gullibility and 
credulity (inherence, depth of processing, and mindless consumption). In 
the third and final section, I briefly connect research findings back to ques¬ 
tions of credulity and gullibility and highlight questions for future research. 

Culture-as-Situated Cognition Theory 

What Does “Situated” Cognition Mean? 

Situated cognition or “thinking in the world” focuses on the impact of 
social contexts on thinking and action (Cesario, Grant, & Higgins, 2004; 
Fiske & Taylor, 2013; Meier, Schnall, Schwarz, & Bargh, 2012; Schwarz, 
2007). Situated cognition approaches suggest that “thinking is for doing.” 
The implication is that people are sensitive to their immediate environ¬ 
ment, use the subset of all their knowledge that is accessible in the moment, 
and interpret what comes to mind in light of contextual demands (Fiske & 
Taylor, 2013; Schwarz, Bless, Wanke, & Winkielman, 2003). 

What a situation implies depends on how one thinks about it - the acces¬ 
sible knowledge and metacognitive experience used to make sense of it. 
Accessible knowledge includes accessible semantic content (Srull & Wyer, 
1979), goals (Forster, Liberman, & Friedman, 2007) and mental proce¬ 
dures (Oyserman & Lee, 2008; Wyer & Xu, 2010; Xu & Schwarz, 2017). 
Accessible metacognitive experiences of ease or difficulty while thinking 
about content, goals, and procedures matter as well (Bless & Schwarz, 2010; 
Fisher & Oyserman, 2017). What metacognitive experiences imply depends 
on the interpretive lens individuals use to make sense of these experiences 
(Alter & Oppenheimer, 2009; Brinol, Petty, & Tormala, 2006; Schwarz, 
2004). Thus, a metacognitive experience of fluency or disfluency can imply 
something about the outside world or it can imply something about one¬ 
self (Alter & Oppenheimer, 2009; Fisher & Oyserman, 2017; Reber & 
Schwarz, 1999; Schwarz, 1994; Schwarz et al., 1991; Smith & Oyserman, 
2015). Unless they have reason to exclude it, people tend to include acces¬ 
sible knowledge and metacognitive experience of ease (fluency) or difficulty 
(disfluency) in their judgments of the situation (Bless & Schwarz, 2010) and 
of themselves (Oyserman, Elmore, Novin, Fisher, & Smith, 2018). 

While people are sensitive to what comes to mind and to their experi¬ 
ence of thinking about what is on their mind, they are not sensitive to the 
specific source of their information or metacognitive experience (Schwarz, 
2005, 2007; this can be termed metacognitive myopia, Fielder, Chapter 7 
this volume). Hence, on-the-mind information or metacognitive experi¬ 
ence likely carries over to a subsequent task. This is the case even if it is 
incidental to, rather than arising from, the task at hand (Bless & Schwarz, 
2010; Schwarz & Clore, 1983). 
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How Does Culture Become a Form of Situated Cognition? 

Culture-as-situated cognition theory (Oyserman, 2011, 2017; Oyserman & 
Lee, 2007) starts with the assumption that humans live in cultures, that cul¬ 
tures address universal demands of living with others, and that people make 
sense of what the immediate context seems to imply using a cultural lens. 
By emphasizing immediate context, culture-as-situated cognition theory 
de-emphasizes speculation about distal causation of current between-group 
differences and reconciles literature documenting what appear to be chronic 
cross-cultural differences with literature documenting situated flexibility 
(Oyserman, 2016). 

The culture-as-situated cognition approach to cultural psychology high¬ 
lights two largely overlooked points: First, culture can be represented as a 
set of associative knowledge networks. Second, these culturally rooted asso¬ 
ciative knowledge networks provide mental models, affording people the 
cultural expertise to predict how situations will likely unfold. 

People have access to and can use multiple culturally rooted associative 
knowledge networks, which one they use depends on which is cued in 
context. These knowledge networks include both cultural mindsets (con¬ 
tent, procedures, and goals related to overarching themes of individual¬ 
ism, collectivism, and honor) and specific culturally rooted (often implicit) 
knowledge about how things work (e.g., what brides wear, what breakfast 
entails). Immediate contexts make some subset of available cultural knowl¬ 
edge networks accessible in the moment. People use this subset to provide 
an organizing implicit frame and to make an automatic prediction about 
what will happen next. Thus, for example, people are better at quickly 
naming a distinct object in a visual array after an individualistic mindset is 
primed (Oyserman, Sorensen, Reber, & Chen, 2009). They are better at 
recalling where objects were in a visual array (Oyserman et al., 2009) and 
are willing to pay more to complete a set (Mourey, Oyserman, & Yoon, 
2013) after a collectivistic mindset has been primed. The implication is that 
the cultural mindset accessible in the moment matters for meaning-making 
because accessible mindsets yield culturally rooted expectations. If expecta¬ 
tions are not met, this requires attention to understand why observation 
mismatches with prediction. 


Defining Culture Within Culture-as-Situated Cognition Theory 

As a starting point, culture-as-situated cognition theory assumes that human 
culture developed from the survival necessity of connecting with others 
and adapting to group living (Boyd & Richerson, 1988; Cohen, 2001; 
Haidle et al., 2015; Oyserman, 2017; Schwartz, 1992). Living together 
requires that people coordinate and organize their relationships, clarify 
group boundaries, and notice and reward innovation so that they can 
imitate or exploit innovation as it occurs and otherwise fit in and know 
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from whom and to whom they owe allegiance (Boyd & Richerson, 2005; 
Kurzban & Neuberg, 2005; Oyserman, 2011; Schwartz & Bardi, 2001). 
Though the basic problems of group living must be addressed, human-made 
cultural solutions can put more emphasis on one or another aspect of these 
depending on ecological niche. In each society, practices evolve to create 
“good enough” ways to regulate relationships, specify group boundaries 
and what to do about them, and spotlight when innovation is acceptable 
or valued (Boyd & Richerson, 2005; Cohen, 2001; Kurzban & Neuberg, 
2005; Oyserman, 2011, 2017; Schwartz, 1992). Coordinating and organ¬ 
izing relationships and noticing and rewarding innovation requires “social 
tuning” —sensitivity to others’ perspectives - and “self-regulation” - the 
ability to control the focus of one’s attention (Chiu et al., 2015; Oyserman, 
2017; Shteynberg, 2015). Indeed, people are sensitive to cues about when 
to imitate (fit in), when to innovate (Clegg & Legare, 2016; Legare & 
Nielsen, 2015), and when group boundaries matter (Boyd, Richerson, & 
Henrich, 2011; Haidle et al., 2015). 

Solutions are “good enough,” rather than optimal. However, once 
developed, they become “sticky” by virtue of being the ways “we” do 
things - “our” structures, practices, norms, and values (Cohen, 2001; 
Oyserman, 2015b). Taken together, this set of good enough solutions 
forms culture, the particular set of practices people in a particular soci¬ 
ety, time, and place share. Once developed, cultural solutions permeate 
all aspects of behavior, constrain and enable perception and reasoning, and 
provide a shared blueprint or outline for meaning-making across a vari¬ 
ety of situations (Chiu, Gelfand, Yamagishi, Shteynberg, & Wan, 2010; 
Nisbett & Norenzayan, 2002; Oyserman, 2017; Shteynberg, Gelfand, & 
Kim, 2009; Shweder & LeVine, 1984; Triandis, 1972, 2007). In this way, 
culture is in part a set of associative knowledge networks, tacit operating 
codes, or meaning-making frameworks through which people make sense 
of their world (Geertz, 1973) and understand what they want, and how 
they go about getting it (Bond, 2002; Fiske, 2002; Kitayama & Markus, 
1994; Sanchez-Burks, Nisbett, & Ybarra, 2000; Swidler, 1986). As a result, 
culturally appropriate situations seem intuitive, right, and obvious while 
culturally inappropriate situations seem odd, off-key, or even wrong. 


Cultural Expertise and Culture-as-Situated Cognition 

From a culture-as-situated cognition perspective, cultural expertise - 
knowing how things work in one’s everyday life — is not reducible to 
whether a culture is comparatively more or less “individualistic,” “col- 
lectivistic,” or “honor” focused (Oyserman, 2017). Cultural expertise pro¬ 
vides a way of knowing what to expect in everyday situations so the world 
feels sensible and orderly. Cultural expertise includes knowing which cul¬ 
tural mindset to use as the situation arises (e.g., an individualistic mind¬ 
set when uniqueness is good and valued; a collectivistic mindset when 
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connecting and relating matters; an honor mindset to know which aspects 
of reputation matter). Cultural expertise is not limited to sensitivity to 
cues as to which cultural mindset to use, it includes knowledge of how 
everyday life unfolds, knowledge of traditions and their sources. People 
gain cultural expertise by being socialized in a society; moving to or living 
in a society yields varying degrees of this expertise (Morris, Chiu, & Liu, 
2015). Whatever way acquired, once culturally expert, people experience 
culture as the simple and obvious way things are. Imagine a beaming bride 
walking down the aisle toward her soon-to-be husband. What color is 
her dress? For Americans, responses to this question often take the form: 
“Well, I mean, the bride does not have to wear white.” The implication is 
that the answer “white” is so obvious that being asked the question can feel 
like a trick or riddle in which the questioner must mean something other 
than the obvious answer that everyone knows. But note, knowing what to 
expect requires American cultural expertise, which Americans in America 
have without noticing it. 

This experience of naturalness, obviousness, and ease is neither reserved 
for Americans nor only applicable to these answers. Answer content — what 
the easy, obvious, and natural answers are - may change across cultures as 
well as across time in a culture, but the feeling of obviousness does not. 
Knowing the culture — the values, norms, practices, and ways of being in a 
particular time and place — means that the answers spring to mind easily and 
feel obvious. Yet, despite this obviousness, variability exists. Consider again 
that bridal dress, brides can and sometimes do marry in dresses of all colors. 
Cultural fluency and disfluency, as detailed next, focuses on the implications 
drawn from this variability. 

Cultural Fluency and Disfluency 
What Is Cultural Fluency and Disfluency? 

Cultural fluency and disfluency are the result of the interface between what 
observers’ cultural expertise leads them to (implicitly) expect, what they 
actually observe, and the meaning they draw from their ensuing meta- 
cognitive experiences of ease or difficulty. What makes for a metacogni- 
tive experience of ease or difficulty is not the observation itself but the 
match or mismatch between observation and culturally rooted expectation. 
Experiencing match or mismatch requires having the cultural expertise to 
know (implicitly) what to expect. These expectations are rooted in one’s 
culture — what one has learned explicitly or picked up implicitly through 
observation and socialization practices. In one’s own culture, cultural flu¬ 
ency may be the norm —having cultural expertise means knowing what is 
likely to occur. Note that the experience of cultural fluency within one’s 
own culture may also be bolstered by the tendency of expectations to guide 
perception of what is experienced (e.g., confirmation bias, Wason, 1960; 
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self-fulfilling prophecies; Merton, 1948; Snyder, 1984; stereotype confir¬ 
mation, Hamilton & Trolier, 1986). In spite of this confirmatory tendency, 
observations sometimes violate expectations and as detailed below, cultural 
disfluency can arise from small differences from expectation. 


What Makes Cultural Fluency and Disjluency Cultural? 

The experience of cultural fluency and cultural disfluency is based in cul¬ 
tural knowledge. That is, as detailed below, without cultural knowledge, 
a cultural product cannot be experienced as disfluent or fluent — it simply 
is. Cultural knowledge sets up implicit expectations, which if met, yield 
easy to process information and if violated, yield more difficult to process 
information. To use a classic example, Bruner and Postman (1949) exposed 
American college students at Harvard and Radcliffe to playing cards and 
assessed latency to correctly identify the card. There were four groups of 
participants; one group saw playing cards in which suit and color fit cultural 
expectation. Another group saw playing cards in which suit and color misfit 
cultural expectations. The two other groups saw different proportions of 
matching and mismatching cards. Playing cards that mismatched cultural 
expectations took longer to correcdy describe and the effect of mismatch 
was particularly pronounced in the context of matches or when presented 
as the first card. There is nothing inherent in the card’s configuration that 
caused this - it is not that a heart or a diamond is easier to identify or that 
red is easier to process than black, it is that the participants came into the 
experiment with cultural knowledge of how playing cards look. Culture, 
of course, is dynamic. That experiment would only replicate with current 
American college students if playing cards were as common a pursuit as it 
seems to have been when that experiment was conducted. 

In this way, cultural fluency and cultural disfluency differ from other 
sources of processing fluency, which are separate from cultural knowledge. 
For example, color contrast and type font used effect ease of processing 
through perceptual rather than cultural channels. It does not require cultural 
knowledge or cultural expectation for a message in black printed on white 
paper to be easier to process than a message in grey printed on grey paper. 
It does not require cultural knowledge for a message printed in 12-font to 
be easier to read than a message printed in 6-font. 

To take another example, people often find giving a few examples easier 
than giving many examples but unless their attention is drawn to the source 
of their experience of ease or difficulty, they tend to draw on their experi¬ 
ence of ease or difficulty to make inferences about truth (Schwarz & Lee, 
Chapter 13 this volume). The inferences people make after experiencing 
ease (or difficulty) when being asked to generate a few (or many) examples 
also do not appear to be culture-bound. That is, the lay theories of what 
ease of generation may imply for truth, expertise, and category size do not 
seem to be rooted in knowledge of a particular culture. 
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Cultural Fluency and Disfluency * Positive and 
Negative Mood 

Cultural disfluency is likely experienced as negative in the same way that other 
disfluency is - at a low level or “primitive” affective response as described by 
Gawronski and Bodenhausen (2007, 2011) as part of associative processing 
of propositions. Getting a measure of this kind of mood effect may require 
using either basic physiological measures or indirect measures such as lik¬ 
ing or consumption (Winkielman, Berridge, & Wilbarger, 2005). While 
negative mood does influence cognitive processing (Forgas, Chapter 10 this 
volume), research to date has not found a connection between self-reported 
mood (obtained by the positive and negative affect scale; Thompson, 2007) 
and cultural fluency and disfluency. Thus, Mourey and colleagues (2015) 
found no effects of cultural fluency and disfluency on mood whether they 
focused on positive (e.g., weddings, holidays) or negative (e.g., funerals, 
obituaries) cultural events in three experiments in the United States and 
Hong Kong. Lin and colleagues (2018) replicated this pattern of null effects 
in two experiments with participants from the United States and Israel using 
different cultural events, Valentine’s Day and breakfast. The implication is 
that cultural fluency and disfluency effects are not simply mood effects. 


What Are the Consequences of Cultural Fluency and Disfluency? 

When things unfold as expected (culturally rooted expectation matches 
observed reality) the metacognitive experience is of ease. Ease implies 
that there is no problem signal, no need to think more. In contrast, when 
things have not unfolded as implicitly expected (culturally rooted expecta¬ 
tion mismatches observed reality) the metacognitive experience is of dif¬ 
ficulty. Difficulty implies a possible problem, requiring consideration of 
why expectations were off the mark. Downstream consequences of cultural 
fluency and disfluency depend on whether people infer that the source 
of their experienced ease or difficulty is external to them (something is 
wrong in the situation) or due to something about themselves (something 
is wrong with me). As depicted graphically in Figure 14.1 and detailed in 
the next three sections, the meaning people draw from ease can be that 
“all’s right with the world” or “no need to think” and the meaning people 
draw from difficulty can be “all might not be as it should be” or “some¬ 
thing went awry here.” 


Cultural Fluency Matters for Gullibility: Inherence 

Defining Inherence 

Psychological inherence is the sense that existing patterns in the world are 
the natural order of things — the way things ought to be (Cimpian, 2015; 
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Figure 14.1 How cultural fluency and disfluency affects likely gullibility and 

credulousness via inherence, depth of processing, and cognitive style. 


Salomon & Cimpian, 2014). It is an implicit process that leads people to 
explain observed patterns in terms of the inherent features of their con¬ 
stituents. So, for example, “girls wear pink, pink is a delicate color, so girls 
must wear pink because pink is a delicate color.” Inherence is an important 
cognitive precursor of category learning via its connection to psychological 
essentialism, the belief that categories are stable, inevitable, and immuta¬ 
ble facilitates category learning. Salomon and Cimpian (2014) developed 
a measure of inherence using items such as: “It seems right that pink is 
the color typically associated with girls,” “It seems ideal that toothpaste is 
typically flavored with mint,” “There are good reasons why dollar bills are 
green,” “It seems natural to use red in a traffic light to mean ‘stop,’” and 
“It seems ideal that weekends consist of Saturday and Sunday.” Higher 
agreement implies that people assume that current social norms are natural 
and ideal rather than one possibility of many. Higher scores on inherence 
imply that the alternatives are not on the mind. People often fail to con¬ 
sider that the link between color and gender is arbitrary though culturally 
rooted. Though traditionally blue for boys and pink for girls may seem 
more obvious than the reverse, both were previously used interchangeably 
as “nursery” colors that symbolized youth rather than gender and when a 
color was to be chosen, blue was the one specified for girls (see Cimpian 
& Salomon, 2014 for a detailed review. The same is true for toothpaste, 
money, and weekends — that toothpaste can have various flavors or none 
at all, that currencies can be many colors, that weekend days are linked to 
societal customs and religions. 
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Given the items used to assess inherence, 1 it may seem that psychologi¬ 
cal inherence is being operationalized as a cognitive limitation, a form of 
credulousness. It is. People who score higher in inherence are more likely 
to essentialize the world around them (Salomon & Cimpian, 2014). People 
who essentialize are more likely to experience differences as immutable. 
This undermines willingness to engage, trust, and cooperate with people 
from categories outside one’s own (Bastian & Haslam, 2006; Chiu, Dweck, 
Tong, & Fu, 1997) and increases acceptance of stereotypes (Bastian & 
Haslam, 2006) and race-based inequality (Morton, Postmes, Haslam, & 
Hornsey, 2009; Williams & Eberhardt, 2008). 


The Evidence 

Lin et al. (2018) conducted five experiments to test the prediction that cul¬ 
tural fluency and cultural disfluency affect inherence. To trigger a cultural 
fluency or cultural disfluency experience, they showed cultural products 
to randomized participants separated into two groups. Each group saw ver¬ 
sions of a cultural product. One group saw “right” (likely expected) versions 
and the other group saw “wrong” likely unexpected versions of the prod¬ 
uct. As a cover story, participants were told that their task was to rate 
the products for quality (or quality and attractiveness). After the prod¬ 
uct-rating task, participants read and rated their agreement or disagree¬ 
ment with the 15 inherence scale items and then rated the traditionality 
and similarity to expectation of the products that they had seen earlier. 
These ratings served as manipulation checks. Indeed, across studies, par¬ 
ticipants in the “right” condition rated the products as higher in quality, 
attractiveness, traditionality, and similarity to expectation than participants 
in the “wrong” condition. The specific product differed in each experi¬ 
ment to test the stability of the effect of cultural fluency and disfluency 
on inherence. 

In the first experiment, Americans saw four Valentine’s Day cards and 
were asked to rate the quality and attractiveness of each card. Half of par¬ 
ticipants saw versions of the “right” (likely expected) Valentine - cards 
that were decorated in hearts in pink and red and filled with warm senti¬ 
ments. The other half of participants saw versions of the “wrong” (likely 
unexpected) Valentine — cards were neutral colored, not pink, were 
decorated with skulls, and the warm sentiments had a spooky under¬ 
tone. The researchers conducted the experiment on Valentine’s Day and 
again a month later. Inherence was lower for the group that had just 
seen the “wrong” Valentines compared to the “right” ones, whether on 
Valentine’s Day or a month later. Results support the prediction that 
cultural fluency enhances and cultural disfluency undermines inherence. 
Participants made (implicit) predictions based on their Valentine’s Day 
associative knowledge network, match and mismatch of observation to 
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prediction mattered for their momentary sense that the way things are 
is the way that they ought to be. Seeing the “right” rather than the 
“wrong” Valentine’s Day card cued inherence. People rated the “wrong” 
cards as less attractive, lower in quality, and less traditional, but none of 
these ratings mattered, fitting the prediction that people are sensitive to 
their experiences of cultural fluency and disfluency but not to the source 
of these experiences. 

In the second experiment, Israelis saw eight photographs of plated 
breakfasts and were asked to rate the quality and attractiveness of each. In 
Israel people typically eat some mix of raw vegetables — especially toma¬ 
toes and cucumber, olives, and some yogurt or fresh cheese along with 
bread or rolls. Cold or hot cereal, meat of any kind, and sweets of any 
kind are not typical. Eggs may be served but not gravy or sauce, waf¬ 
fles, French toast, or pancakes. Those randomized to the “right” (likely 
expected) breakfast group saw breakfast plates with raw vegetables, yogurt, 
and fresh rolls. In contrast, Israelis randomized to the “wrong” (likely 
unexpected) breakfast group saw breakfast plates with meats, cheeses, and 
pastries. Inherence was lower for the group that had just seen the “wrong” 
breakfasts compared to the “right” ones. As manipulation checks, people 
were asked to rate the photographs for quality and attractiveness and the 
breakfasts themselves for traditionality. As would be expected if they were 
disfluent, people rated the “wrong” breakfasts as less attractive, lower in 
quality, and less traditional. Fitting the prediction that people are sensi¬ 
tive to their experiences of cultural fluency and disfluency but not to 
the source of these experiences, people randomized to see the “wrong” 
breakfasts were lower in inherence than people randomized to see the 
“right” breakfasts - they were less likely to agree with the items on the 
Cimpian and Salomon (2015) inherence scale. This effect was not medi¬ 
ated by attractiveness, fluency, and quality ratings. 

In the third experiment European Americans saw four photographs 
from a wedding of a European American bride and groom and were asked 
to rate the quality of each photograph. Those randomized to the “right” 
(likely expected) wedding group saw wedding photographs of a bride in 
a white gown, a groom in a black tuxedo, a white-fondant-iced tiered 
wedding cake, and a formal but homelike wedding setting. In contrast, 
those randomized to the wrong (likely unexpected) wedding group saw 
wedding photographs of a European American couple, the bride in a black 
gown and the groom in a white tuxedo, a black-fondant-iced tiered wed¬ 
ding cake, and a beautiful but industrial setting. Inherence was lower for 
the group that had just seen the “wrong” wedding scenes compared to the 
“right” ones. People rated the photographs with the “wrong” wedding 
scenes as lower in quality. They rated them as less traditional. These ratings 
did not affect inherence, fitting the prediction that people are sensitive to 
their experiences of cultural fluency and disfluency but not to the source 
of these experiences. 
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In the fourth experiment, Han Chinese saw five photographs from 
a wedding of a Han Chinese bride and groom and rated the quality of 
each photograph. Those randomized to the “right” (likely expected) 
wedding group saw wedding photographs of a Han Chinese couple, the 
bride in a white gown and the groom in a dark suit, guests in various 
outfits, and a car decorated with flowers. In contrast, those randomized 
to the “wrong” (likely unexpected) wedding group saw wedding pho¬ 
tographs of a Han Chinese couple, the bride in a black gown and the 
groom in a dark suit, guests in various outfits, and a car decorated with 
fruits. Inherence was lower for the group that had just seen the “wrong” 
wedding scenes compared to the “right” ones; as before, quality and 
traditionality ratings did not affect the relationship between the kind of 
wedding viewed and inherence. 

The fifth experiment involved American participants and took place 
just before Labor Day. Researchers randomized participants to one of 
three groups, adding a neutral control group, as detailed next. Each 
group saw four Labor Day shopping bags and was asked to rate the qual¬ 
ity and attractiveness of the shopping bag designs. In the “right” (likely 
expected) group, the shopping bags had a “Happy Labor Day” logo with 
a red white and blue and patriotic-themed design of a flag or fireworks. 
In contrast, in the “wrong” (likely unexpected) group, the logo read 
“Shopping Bag” (no reference to Labor Day), with a vaguely environ¬ 
mentally friendly color scheme (brown and green) and environmental 
designs (animals, trees). The control group saw four photographs of 
shopping bags with a “Happy Labor Day” but with an environmentally 
friendly color scheme and animal or plant designs rather than a patriotic- 
themed color and design. Inherence was lower for the group that had 
just seen the “wrong” Labor Day designs compared to the “right” ones 
or the “control” ones. People rated the photographs with the “wrong” 
Labor Day bags as less attractive, lower in quality and less traditional. 
These ratings did not affect inherence, fitting the prediction that people 
are sensitive to their experiences of cultural fluency and disfluency but 
not to the source of these experiences. 

A meta-analyses across the studies showed that the mean effect of view¬ 
ing culturally fluent vs. disfluent products was small-to-moderate (d = .38). 
The 95% confidence interval (.24 to .53) suggested that the true effect of 
cultural fluency and disfluency on inherence ranges from small to moderate- 
to-large. Across studies, effects of condition were direct, not mediated or 
moderated by ratings of quality, attractiveness, or traditionality and the test 
of heterogeneity was not significant. Taken together, results fit the culture- 
as-situated cognition theory prediction that people are sensitive to their 
experiences of cultural fluency and disfluency but not to the source of 
these experiences. Experiences of cultural fluency or disfluency carry over 
to subsequent judgments even when the cultural experience is irrelevant to 
the judgment task. 
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In sum, across studies, the downstream consequence of experiencing a 
match with cultural expectations is preservation of a sense of inherence; this 
sense of inherence is disrupted by a mismatch with cultural expectations. If 
the world is as it should be, then there is no need to consider whether there 
is any reason for the current order of things. That implies that any message 
that can be packed in culturally fluent language and images will be processed 
as likely correct in its essence, the way things ought to be, without further 
processing. “As American as apple pie and baseball” is a saying that evokes 
this sense that once an element is included in the culturally fluent mix, it too 
will be tagged with acceptance without processing further. 

Cultural Fluency Matters for Gullibility: Reasoning 

Defining Reasoning 

To form judgments, assess the quality of persuasive arguments, and make 
sense of their experiences, people can use gist-based, associative reasoning, 
and rule-based systematic reasoning. That is, they can process information 
in terms of their gut “feeling” using peripheral cues such as whether the 
information seems familiar. They can also process information in terms of 
rules, using central cues such as the quality of the arguments and whether 
the source of the information is credible. 

The culture-as-situated cognition prediction is that in culturally flu¬ 
ent situations in which observation seems to match implicit expectations, 
processing can remain gist-based and shallow. In contrast, since experi¬ 
enced cultural disfluency is a problem signal, it should increase scrutiny 
of arguments, focusing attention on their quality and decreasing reliance 
on peripheral cues. The question relevant to gullibility and credulousness 
is whether cultural fluency results in sticking with gist-based reasoning in 
contexts requiring systematic reasoning and whether it bolsters shallow pro¬ 
cessing of persuasive arguments. In this section, I focus on evidence related 
to systematic reasoning. In the next section, on mindlessness, I focus on 
evidence related to reliance on peripheral cues. 


The Evidence 

Mourey et al. (2015) addressed the question of whether the predicted effect 
of cultural fluency and cultural disfluency on reasoning styles is found by 
testing participants on a task specifically devised to have a gut-based and 
a rule-based answer (a version of the three-item cognitive reflection task 
(CRT), Frederick, 2005). Here is an example from the original CRT 
task: “A fishing rod and fishing bait cost $11 in total. The fishing rod costs 
$10 more than the bait. How much does the bait cost?” The gut-based 
(“wrong”) response is $1 based on the gist focus on the “$10” piece of 
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information resulting in simply subtracting $10 from $11 ($11—$10 = $1). 
The rule-based (“correct”) response is $.50 based on the rule-based focus 
on the “$10 more” as a piece of information resulting in the equation: 
$ll=n+(n + $10). People give the gut-based or the rule-based response - 
with only a few people giving un-codeable answers (in the above example, 
answers other than $1.00 or $.50). 

As detailed next, Mourey and colleagues (2015) conducted four relevant 
experiments. One experiment involved having or not having the color pink 
as a border on Valentine’s Day or after Valentine’s Day. Two experiments 
involved photographs of weddings. A final experiment involved reading 
obituaries. In each experiment the researchers randomized participants into 
two groups. One group saw versions of a cultural product that met likely 
expectation (they looked “right”). In contrast, the other group saw ver¬ 
sions of the same product that likely mismatched with their culture-based 
expectations (they looked somehow “wrong”) or were irrelevant to their 
culture-based expectations (control groups). After the rating task, all par¬ 
ticipants were asked to “Click the arrow to proceed to the next task” (the 
cognitive task). 

The first experiment took place in Ann Arbor, Michigan (United 
States) and in Hong Kong, S.A.R. China. In each country, participants 
were randomized to see either a pink border or not while working on the 
cognitive task. In each country, participants were either given the task 
on Valentine’s Day or a week after Valentine’s Day. The four-condition 
between subject design included one cultural fluency group - in this 
condition, participants saw pink on Valentine’s Day. 2 Pink is the “right” 
color for Valentine’s Day but only on Valentine’s Day, otherwise it is just 
a color. The other three groups were control groups, testing the predic¬ 
tion that the group experiencing cultural fluency would reason less sys¬ 
tematically than the group that participated on Valentine’s Day without 
the pink border, the group that experienced a pink border but not on 
Valentine’s Day, and the group that experienced neither a pink border 
nor Valentine’s Day. The pink alone and Valentine’s Day alone cues were 
assumed not to be sufficient to activate the Valentine’s Day associative 
knowledge network. Fitting the prediction that people are sensitive to 
their experiences of cultural fluency and disfluency, systematic-reasoning 
was lower for the group that had just seen the “right” color at the “right” 
time (pink on Valentine’s Day). They were more likely to give the wrong 
$10 answer than participants in the three other conditions — and people 
in these latter three groups did not differ from each other. 

The second and third experiments took place in the U.S. American 
group, where participants rated the quality of a wedding photographer’s 
photographs. American participants randomized to the “right” condi¬ 
tion saw eight photographs of a bride in white, a groom in black, their 
white-fondant-iced tiered wedding cake, and their wedding party with 
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bridesmaids and groomsmen. The eight photographs American partici¬ 
pants randomized to the “wrong” condition saw were from the same 
wedding photographer’s website but showed a bride in a dress with some 
green and purple and a groom whose tuxedo also had some purple. Their 
tiered wedding cake was decorated with colorful cogs, and there was no 
wedding party. Participants rated the quality of each photograph. Then 
they were given the cognitive task and rated the traditionality of the pho¬ 
tographs that they had seen overall. Systematic reasoning was lower for 
the group that had just seen the “right” wedding photographs compared 
to the “wrong” ones. Effects were not due to photograph quality ratings 
or wedding traditionality, fitting the prediction that people are sensitive to 
their experiences of cultural fluency and disfluency but not to the source 
of these experiences. 

In a fourth experiment, American participants read two versions of the 
same obituary and made a choice as to which version the family should use. 3 
American participants randomized to the “right” condition read two ver¬ 
sions of an obituary in which the deceased was praised and her loss mourned 
by her children. Americans randomized to the “wrong” condition read two 
versions of an obituary in which the deceased was not praised and her loss 
not mourned by her children. After making their choice, participants were 
given the cognitive task and rated the traditionality of the obituaries that 
they had seen overall. Systematic reasoning was lower for the group that 
had just seen the “right” obituaries compared to the “wrong” ones. Effects 
were not due to traditionality, fitting the prediction that people are sensitive 
to their experiences of cultural fluency and disfluency but not to the source 
of these experiences. 

In sum, all four experiments supported the prediction that culture- 
based metacognitive experience of ease (fluency) and difficulty (dis¬ 
fluency) influences cognitive style. Each study showed that fluent and 
disfluent conditions differed. The pink on Valentine’s Day study sug¬ 
gested that the difference was due to the undermining effect of cultural 
fluency — systematic reasoning was less likely in the cultural fluency 
condition than in control conditions. Cultural fluency preserved gut- 
based associative processing. Cultural disfluency shifts processing to 
rule-based systematic processing. These studies document that process¬ 
ing ease when likely expectations matched observation and process¬ 
ing difficulty when likely expectations mismatched observation carried 
over to the next judgment task. A single study meta-analyses across the 
experiments yielded a moderate-to-large effect size (d = .46) and 95% 
confidence interval (.26 to .65) and the test of heterogeneity was not 
significant. The implication is that the true effect of cultural fluency and 
disfluency on processing style is in the moderate-to-large range and that 
results are not dependent on the particular samples or cultural situations 
used. Across studies, cultural fluency effects were direct, not mediated or 
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moderated by ratings of quality or traditionality. Taken together, results 
fit the culture-as-situated cognition theory prediction that people are 
sensitive to their experiences of cultural fluency and disfluency but not 
to the source of these experiences. Experiences of cultural fluency or 
disfluency carry over to subsequent judgments even when the cultural 
experience is irrelevant to the judgment task. 

Cultural Fluency Matters for Gullibility: 

Mindless Consumption 

Defining Mindless Consumption 

Mindless consumption occurs when people choose, buy, consume, or take, 
as if without thinking, on impulse. I use the term mindless consumption 
whether what is being consumed is a food, a consumer good, or a persuasive 
argument. I do so to highlight that the underlying process of “mindlessness” 
entails shallow processing based on superficial cues and reliance on gut- 
based rather than rule-based processing. The literature on the relationship 
between cultural fluency and disfluency and mindless consumption whether 
of food, consumer goods, or persuasive arguments is just emerging. 

Culture-as-situated cognition theory predicts that culturally fluent situ¬ 
ations, ones that unfold as likely expected, will increase propensity toward 
mindless consumption and credulity — easy persuasion with superficial cues 
that fit culture-based associative knowledge networks. People should be 
more likely to go with the flow — approach when contexts cue approach 
and avoid when contexts cue avoidance - and to be persuaded by peripheral 
cues under conditions of cultural fluency. Note that this effect should be 
limited to situations in which experienced fluency (ease) and disfluency (dif¬ 
ficulty) are interpreted as being about the context itself rather than as being 
about the self. If experienced cultural fluency and disfluency are taken to 
imply something about the self, then cultural disfluency is depleting, yield¬ 
ing a sense of “Perhaps I am not competent.” In this section, I provide the 
emerging evidence on mindless consumption. 


The Evidence 

Mourey and colleagues (2015) addressed the question of mindless consump¬ 
tion in four experiments. In one experiment, the dependent variable was 
the weight of food American participants put on their plates, in a second 
experiment it was the size of the portion American and Hong Kong Chinese 
participants chose in a virtual buffet, in the third and fourth experiments, 
the dependent variable was the likelihood of buying a consumer product. 

In one naturalistic field experiment, American participants attending 
actual 4th of July or Labor Day picnics were randomized to receive one 
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of two different plates as they waited to choose their picnic. After putting 
their food on their plates, plate weight was unobtrusively obtained. On 
the 4th of July, participants were given either a patriotic themed plate or a 
non-decorated control plate. On Labor Day, participants were given either 
a non-decorated control plate or a plate with animals and plants. Participants 
provided a culturally fluent plate put significantly more (by weight) food 
on their plates than those provided a control plate (25% more). Participants 
provided a culturally disfluency plate put significantly less food on their 
plate (18% less) than those provided a control plate. The field study method 
only allowed for a simple debrief. Participants reported not noticing the 
plate decorations. 

In a second more controlled experiment, college student participants 
in Ann Arbor, Michigan (United States) and Hong Kong S.A.R. China 
were asked to go online to rate the quality of a local Chinese buffet. Half 
of participants were invited to participate during Chinese New Year and 
half a month after Chinese New Year. When students went online, they 
were given a plate, shown prepared dishes, and asked what size portion 
they would like to try. The plates were randomly assigned to have either a 
red or black border. This two (during Chinese New Year or not) by two 
(red or not) by two (American, Chinese) design yielded a cultural fluency 
group (Chinese New Year and red and Chinese) and seven control con¬ 
ditions. Participants in the cultural fluency group chose more food than 
other participants. Red is a color associated with Chinese New Year for 
Chinese, after Chinese New Year it is just a color. Mindless consumption 
was higher in the cultural fluency group than in the Chinese comparison 
groups and the American groups. Indeed, our American participants were 
unaware of the timing of Chinese New Year and did not associate red 
with this holiday. 

In a third experiment, participants were exposed to the wedding photo¬ 
graphs described in the prior section. They were asked to rate the quality of 
the photographs and then offered a wedding-irrelevant consumer product 
(a shovel) and asked about their likelihood of purchasing it. Likelihood to 
purchase was higher in the cultural fluency condition in which participants 
saw the “right” wedding compared to the “wrong” wedding and effects 
were not mediated by participant-reported quality or traditionality ratings. 

In a fourth experiment, participants were exposed to the obituaries 
described in the prior section and then offered a funeral-irrelevant con¬ 
sumer product (a key fob charger, a key fob phone finder) and asked about 
their likelihood of purchasing it. Likelihood to purchase was higher in the 
cultural fluency condition in which participants saw the “right” obitu¬ 
ary compared to the “wrong” obituary and effects were not mediated by 
participant-reported traditionality ratings. 

All four experiments supported the prediction that culture-based 
metacognitive experience of ease (fluency) and difficulty (disfluency) 
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influences mindless consumption. Each study showed that fluent and dis— 
fluent conditions differed. The results of the patriotic holiday picnic study 
suggested that the difference was due both to the mindlessness boosting 
effect of cultural fluency and to the mindfulness boosting effect of cultural 
disfluency. More food was put on the plate when the plate had patriotic 
theme decorations rather than being plain and less food was put on the 
plate when the decorations of plants and animals did not fit the patriotic 
theme. The cues were cultural - people who did not know the culture 
were unaware of and not influenced by what would have been a match 
to expectation - they had nothing to expect. Mindlessness did not require 
that the cultural event be positive, mindless choice was higher for cultur¬ 
ally fluent funeral and wedding cues. Cultural fluency preserves or even 
boosts mindless “go with the flow” use of superficial cues. Cultural dis¬ 
fluency shifts to mindful processing and use of more central cues. These 
studies document that processing ease when likely expectations matched 
observation and processing difficulty when likely expectations mismatched 
observation carried over to the next judgment task. 

A single study meta-analyses across the experiments yielded a small- 
to-moderate effect size (d = .28) and 95% confidence interval (.12 to .44) 
and the test of heterogeneity was not significant. The implication is that 
the true effect of cultural fluency and disfluency on mindlessness is in 
the small-to-moderate range and that results are not dependent on the 
particular samples or cultural situations used. Across studies, cultural flu¬ 
ency effects were direct, not mediated or moderated by ratings of quality 
or traditionality. Taken together, results fit the culture-as-situated cogni¬ 
tion theory prediction that people are sensitive to their experiences of 
cultural fluency and disfluency but not to the source of these experi¬ 
ences. Experiences of cultural fluency or disfluency carry over to subse¬ 
quent judgments even when the cultural experience is irrelevant to the 
judgment task. 

Future Directions: Cultural Fluency, Gullibility, 
and Credulity 

Taking a culture-as-situated cognition approach to culture spotlights an 
underappreciated aspect of culture, which is that it allows people to get 
through their days without much thought while also alerting them when 
attention might be warranted. In their own culture, people mostly experi¬ 
ence situations that match their (implicit) expectations. The ensuing meta- 
cognitive experience of ease implies that not much thought is needed; 
however, situations vary, and sometimes these (implicit) expectations are 
violated. When that happens, the ensuing metacognitive experience is 
one of difficulty. Something feels awry, and closer consideration is war¬ 
ranted. The terms “cultural fluency” and “cultural disfluency” capture both 
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the cultural and the metacognitive (thinking about thinking) aspects of 
this process. Cultural fluency and disfluency are the result of the interface 
between what observers’ cultural expertise leads them to (implicidy) expect, 
what they actually observe, and the meaning they draw from their ensu¬ 
ing metacognitive experience of ease when observation and expectation 
match or difficulty when observations violate expectations. Interpretation 
is the result of drawing meaning from the metacognitive experience of ease 
when culturally rooted implicit expectations match observations and from 
the metacognitive experience of difficulty when culturally rooted implicit 
expectations are violated (or do not match observations). Downstream con¬ 
sequences for thinking, feeling, and doing depend on whether people infer 
that the source of experienced ease or difficulty is external (in the situa¬ 
tion) or internal (themselves). Interpretation does not require explicit self¬ 
reportable thoughts or emotions such as “This is not traditional!” or “This 
is not similar to what I do!” or "I don’t feel happy!” or “I feel anxious!” or 
“I feel angry!” 

Culture-as-situated cognition theory predicts that accessible cultur¬ 
ally rooted associative knowledge networks focus attention on some cues 
and not on others. People automatically make predictions as to what will 
happen next and experience cultural fluency when observation matches 
expectation. As summarized in this chapter, an emerging body of evidence 
supports the culture-as-situated cognition theory prediction that one 
function of cultural expertise is to provide predictions as to how life will 
unfold. When these predictions seem to be supported, yielding a good 
enough match with unfolding reality, people experience cultural fluency. 
Cultural fluency is associated with higher inherence — the feeling that the 
way things are now is the way they ideally ought to be, more gut-based - 
associative reasoning, and more mindlessness. In contrast, when observa¬ 
tion does not support prediction, people experience cultural disfluency. 
Cultural disfluency is associated with lower inherence, more systematic 
reasoning, and more mindfulness. The average size of this cultural disflu¬ 
ency effect is moderate-to-large for shift to systematic, top-down, date- 
driven processing, and drop in experienced inherence, while the average 
size of the effect on mindless consumption is small. The implication of 
these results is that cultural fluency should be associated with higher will¬ 
ingness to accept and even act on claims or persuasive arguments that 
provide poor quality arguments but do not disrupt or even themselves 
trigger cultural fluency - they are framed to fit culturally rooted expecta¬ 
tions. Making a small choice, decision, or commitment within a culturally 
fluent context that one would otherwise not make can trigger a spiral 
of congruent choices particularly if the culturally fluent context remains 
accessible. Cooper and Avery (Chapter 16 this volume) describe how this 
course of action can be difficult to undo for people who are sensitive to 
the possibility that they were duped or overly credulous. 
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Culture-as-situated cognition theory also predicts that culturally rel¬ 
evant cues require attention and care; hence, the quality of persuasive 
argument matters in culturally disfluent situations. There are two as yet 
not fully explored implications of this formulation: First, effects on will¬ 
ingness to accept shallow arguments. Second, effects on willingness to 
justify the current state of affairs. 

Consider first shallow arguments. A cultural fluency perspective implies 
that culturally irrelevant cues are either unnoticed or are noticed but pro¬ 
cessed shallowly. In order for people to be motivated to centrally process an 
argument in the first place, the topic must feel relevant to them (see Macrae, 
Olivier, Falben, & Golubickis, Chapter 11 this volume). Once an argument 
is experienced as relevant, it will be processed differently in a culturally fluent 
vs. a culturally disfluent context. Cultural disfluency is predicted to reduce 
certainty in the links in an associative knowledge network. Of course if the 
same culturally disfluent experience is repeated, then, over time, this should 
result in the network accommodating new knowledge (see Unkelbach & 
Koch, Chapter 3 this volume). How long this process takes is as yet unstud¬ 
ied but once it occurs, the formerly disfluent will become fluent. 

Consider next the link between a cultural fluency perspective and system 
justification. Through affecting inherence, cultural fluency and disfluency 
are likely to have implications for people’s perception of whether social sys¬ 
tem is fair and just with culturally fluency carrying over to a more general 
sense that the current state of affairs is ideal (Hussak & Cimpian, 2015; Jost 
& Hunyady, 2005; Kay et al., 2009). Because the link between gullibility, 
credulousness, and cultural fluency is just beginning to be explored, future 
research is needed to test the prediction that people are more willing to act 
on information provided in a culturally fluent context. Research to date has 
shown willingness to consume but has not direcdy tested acceptance of per¬ 
suasive arguments. Future research testing responsivity to weak arguments, 
and truth judgments given culturally fluent vs. disfluent cues is sorely needed. 

People do not want to be gullible (Cooper & Avery, Chapter 16 this 
volume) but at the same time, they are less likely to use top-down sys¬ 
tematic processing in settings that feel culturally fluent, which match their 
expectations. Cultural fluency bolsters a feeling of inherence, that things are 
as they should be and might reduce people’s likelihood of processing for 
an alternative to a presented argument or claim (Mayo, Chapter 8 this vol¬ 
ume). While experiencing cultural fluency may be a subtle mood enhancer 
(Forgas, Chapter 10 this volume), future research is needed to consider ways 
in which cultural disfluent experiences might help reduce people’s willing¬ 
ness to suspend disbelief in processing potentially dubious claims. Cultural 
fluency may support gullibility and credulousness simply because getting 
through the day typically does not involve processing information through 
a lens of suspicion, but quite the opposite, processing through a lens that 
facilitates experience of inherence — that all is right with the world. 
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Notes 

1 Items such as: “It seems right that pink is the color typically associated with 
girls,”“It seems ideal that toothpaste is typically flavored with mint,’’“There are 
good reasons why dollar bills are green,” “It seems natural to use red in a traffic 
light to mean ‘stop,’” and “It seems ideal that weekends consist of Saturday and 
Sunday.” 

2 Note that pink is part of the associative knowledge network for Valentine’s 
Day but unlike the Valentine’s Day card itself, the color pink is not exclusive to 
Valentine’s Day. 

3 To create the two versions, the researchers rearranged the order of the sentences 
but kept the content exactly the same. The “wrong” obituary was found in an 
online edition of a local newspaper and was lightly edited to create the “right” 
version. For example “had no hobbies . .. will not be missed” in the original was 
edited to “had numerous hobbies .. . will be missed.” 
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“Gullible” means easily deceived or cheated. In this chapter, we focus on 
the deception aspect of gullibility. What does gullibility have to do with 
social psychology? Scientific gullibility occurs when individuals, including 
scientists, are “too easily persuaded that some claim or conclusion is true, 
when, in fact, the evidence is inadequate to support that claim or conclu¬ 
sion.” In this chapter, we review evidence of the sources and manifestations 
of scientific gullibility in (mostly) social psychology, and also identify some 
potential preventatives. 

Before continuing, some clarifications are necessary. We have no insight 
into, and make no claims about, what any scientist “thinks” or “believes.” 
What we can address, however, are statements that have appeared in schol¬ 
arship. In this chapter, when a paper is written as if some claim is true, we 
take that to mean that it is “accepted,” “believed,” “assumed to be valid,” 
and/or “that the scientist was persuaded that the claim was valid and justi¬ 
fied.” When we do this, we refer exclusively to written statements in the 
text, rather than to someone’s “beliefs,” about which we have no direct 
information. Issues of whether and why scientists might make claims in sci¬ 
entific scholarship that they do not truly believe are beyond the scope of this 
chapter, though they have been addressed elsewhere (e.g., Anomaly, 2017). 

Furthermore, we distinguish scientific gullibility from being wrong. 
Scientists are human, and make mistakes. Even fundamental scientific 
methods and statistics incorporate uncertainty, so that, sometimes, a well- 
conducted study could produce a false result - evidence for a phenomenon, 
even though the phenomenon does not exist, or evidence against the exist¬ 
ence of some phenomenon that does. Thus, scientific gullibility is more 
than being wrong; error is baked into the nature of scientific exploration. 
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We define scientific gullibility as being wrong, in regards to the strength and/ 
or veracity of a scientific finding, when the reasons and/or evidence for 
knowing better were readily available. Thus, demonstrating scientific gul¬ 
libility means showing that (1) scientists have often believed something that 
was untrue, and (2) there was ample basis for them to have known it was 
untrue. 

Overview 

Why should scientists be interested in better understanding their own gul¬ 
libility? We think it is because most of us do not want to be gullible (see 
Cooper & Avery, Chapter 16 this volume). Although there may be a small 
number who care more about personal success, they are likely rare excep¬ 
tions. Most researchers genuinely want to know the truth and want to pro¬ 
duce true findings. They want to be able to critically understand the existing 
literature, rather than believe that false claims are true. A better understand¬ 
ing of scientific gullibility then, can (1) reduce the propensity to believe 
scientific claims that are not true; and (2) increase awareness of the logical, 
evidentiary, methodological, and statistical issues that can call attention to 
claims that warrant increased skeptical scrutiny. In this context, then, we 
suggest the following five flags of gullibility as a starting point, we also wel¬ 
come suggestions for additional symptoms of gullibility: 

Criteria 1. Generalization of claims that are based on data obtained from 
small, potentially unrepresentative samples. 

Criteria 2. Causal inference(s) drawn from correlational data. 

Criteria 3. Scholarship offering opposing evidence, an opposing argu¬ 
ment, or a critical evaluation of the claim being presented as fact is 
overlooked (e.g., not cited). 

Criteria 4. Claims, and possibly generalized conclusions, are made with¬ 
out citing empirical evidence supporting them. 

Criteria 5. Overlooking (e.g., not citing and/or engaging with) obvi¬ 
ous and well-established (in the existing scientific literature) alternative 
explanations. 

We first review basic methodological and interpretive standards involved in 
scientific inference. Next, we review evidence regarding the psychology of 
gullibility. In general, and in science, why do people often believe things 
that are untrue when they should have known better? A series of cases are 
then reviewed, where there was, and may still be, belief in erroneous con¬ 
clusions, and where the evidence revealing how and why those conclusions 
are erroneous is sufficiently apparent. We conclude the chapter with recom¬ 
mendations for reducing scientific gullibility, including possible reforms to 
the academic incentive structure. 
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Methods, Statistics, and Their Interpretation 

It may seem obvious to state that, in science, claims and conclusions require 
evidence. But, as we shall show below, even this most basic standard has 
been violated by some social psychological scholarship, as some canonical 
claims rest on almost no evidence at all. Assuming some sort of empirical 
evidence does exist, its mere existence does not automatically support any 
particular conclusion, even if the article reporting the conclusion says it 
does. Basic and widely accepted methodological standards in social psy¬ 
chology include obtaining representative samples of people, preferably from 
many places all over the world, if one wishes to generalize findings; that 
large samples are needed to minimize uncertainty in parameter estimates; 
and that causal inference requires experimentation. 


Standards for Data Collection 

High power can usually be obtained with a large sample or through use 
of within subject designs. Although high-powered designs do not guar¬ 
antee high quality, low-powered designs typically produce results with 
such high levels of uncertainty (as indicated by wide confidence inter¬ 
vals surrounding point estimates) that it is difficult to conclude the find¬ 
ings mean very much (Fraley & Vazire, 2014). Causal inferences are least 
problematic when hypotheses are tested with experiments, though experi¬ 
mentation alone does not guarantee correct causal inferences. Statistical 
uncertainties, methodological imperfections, and the potential that 
untested alternative explanations remain all constitute threats to the valid¬ 
ity of experimentally based causal inferences. Additionally, researchers can 
sometimes influence the behavior of their subjects (Jussim, 2012; Jussim, 
Crawford, Anglin, Stevens, & Duarte, 2016), and random assignment to 
condition and experimenter blindness are two well-established ways of 
reducing this potential influence. 


Standards for Data Interpretation 

We use the term “fact” as elucidated by Stephen Jay Gould (1981): “In 
science, ‘fact’ can only mean ‘confirmed to such a degree that it would be 
perverse to withhold provisional assent.’” We agree and add this corollary: 
Anything not so well established that it would not be perverse to withhold 
provisional assent is not an established scientific fact. When there are con¬ 
flicting findings and perspectives in a literature, it is not perverse to believe 
otherwise, rendering it premature for scientists to present some claim as an 
established fact. 

The presentation of confirmatory evidence is not sufficient to establish 
the veracity of a claim, even if the confirmatory evidence cited is relevant 
and sound (Roberts & Pashler, 2000). In other words, the conclusion may 
still not be justified, as evidence inconsistent with the conclusion that is on 
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at least as sound a footing may exist. The presence of such evidence should 
prevent the conclusion from being presented as an established fact. Even 
in the absence of conflicting evidence, claims based on a limited body of 
research (e.g., a small number of studies with small samples; a single study) 
require further investigation before they can be considered established. 
Furthermore, the validity of some conclusion hinges not merely on the 
consistency of the data with that conclusion, but with the ability to elimi¬ 
nate alternative explanations for the same data (Roberts & Pashler, 2000). 

Finally, it behooves social psychologists (and social scientists in general) 
to acknowledge there is a multiverse of potential ways to construct each 
unique data set for analysis (Steegen, Tuerlinckx, Gelman, & Vanpaemel, 
2016). Within this multiverse, researchers may have to make many deci¬ 
sions about how to proceed, and thus the published findings typically rep¬ 
resent one of many ways to analyze the data. Acknowledging this may limit 
social psychologists’ vulnerability to drawing conclusions of questionable 
veracity (see Miller & Chapman, 2001; Nunes et al., 2017; Roberts & 
Pashler, 2000). 

The Psychology of Scientific Gullibility 

What are the sources of scientific gullibility? Although there may be many, 
in this chapter, we focus on four: motivated reasoning, excess scientism, 
status biases, and status quo biases. 


Motivated Reasoning 

A number of factors sometimes lead scientists to reach conclusions that have 
questionable validity. How can individuals who are trained to be objective, 
methodical, and precise make such errors? One way is through motivated 
reasoning (MacCoun, 1998), which occurs when the desire to reach a par¬ 
ticular conclusion, rather than an accurate conclusion, influences the pro¬ 
cessing of evidence (Kahan, Jenkins-Smith, & Braman, 2011). People may 
be motivated to reach conclusions they would like to be true (desirability 
bias', Tappin, van der Leer, & McKay, 2017), conclusions they believe are 
true based on prior evidence and experience (confirmation bias; Nickerson, 
1998), or a combination of the two. 

Many theorists argue that motivated reasoning is driven by “hot,” affec¬ 
tive processes: information produces an intuitive response, which then 
guides cognitive processing of the information. When information supports 
preferred conclusions, people experience positive affect and easily accept 
the evidence (Klaczynski, 2000; Munro & Ditto, 1997). When information 
supports an undesired (or belief-inconsistent) conclusion, however, peo¬ 
ple experience negative affect and critique, ignore, or reject the evidence 
on irrelevant grounds (Klaczynski, 2000; Munro & Ditto, 1997). These 
processes — particularly confirmation biases - can also be driven by “cold,” 
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logical cognitive strategies (Fischhoff & Beyth-Marom, 1983; Koehler, 
1993). Beliefs form from prior evidence and experience, and thus it may 
be rational to subject new evidence that deviates from prior knowledge to 
greater scrutiny. 

Moreover, although the desire to reach a particular conclusion can bias 
information processing, when accuracy motivations are strong, people may 
process evidence systematically in order to draw accurate conclusions based 
on the quality of the evidence, regardless of their prior or desired beliefs 
(Anglin, 2016; Klaczynski, 2000). People are motivated to reach conclu¬ 
sions that are compatible with their beliefs and preferences, but they are also 
motivated to be accurate (Hart et al., 2009), and can only arrive at desired 
conclusions if they are justifiable (Haidt, 2001). 

What strategies allow people to justify their desired conclusions? They 
seek out evidence supporting a favored conclusion while ignoring evidence 
challenging that view (positive or confirmatory information seeking and hypothesis 
testing; Klayman & Ha, 1987), evaluate evidence more favorably (e.g., as 
more accurate, reliable, and convincing) when it supports versus challenges 
a desired conclusion ( biased evaluation), deduce the relevance or meaning 
of evidence based on its consistency with desired conclusions ( biased inter¬ 
pretation), assign greater weight to evidence supporting desired conclusions 
(.selective weighting), and selectively retrieve supportive (but not conflicting) 
evidence from memory ( biased recall). 

Scientists are not immune to these biases (Jussim, Crawford, Anglin, 
Stevens et al., 2016; Lilienfeld, 2010). In fact, research suggests that indi¬ 
viduals with greater knowledge and expertise on a topic may be susceptible 
to motivated reasoning (Ditto et al., in press). At each stage of the research 
process, researchers’ beliefs and motives can influence their research deci¬ 
sions. Collectively, the beliefs and motives of researchers - particularly polit¬ 
ical beliefs — may form significant blind spots or vulnerabilities, increasing 
the risk that certain questions aren’t asked or investigated, that data are mis¬ 
interpreted, or that conclusions of a convenient, exaggerated, or distorted 
nature are generated (Duarte et al., 2015; Jussim, 2012; Tetlock, 1994). 

We have previously elaborated on political confirmation biases and how 
they may influence each stage of the research process (Stevens, Jussim, 
Anglin, & Honeycutt, 2018). Whether explicitly realized by research¬ 
ers or not, these biases can exert their influence in a variety of ways. For 
instance, when generating hypotheses, researchers may, unintentionally, 
selectively expose themselves to research supporting a desired narrative or 
conclusion, neglecting to account for alternative perspectives or conflict¬ 
ing evidence. During data collection researchers can fall prey to experi¬ 
menter or expectancy effects (Jussim, 2012; Jussim, Crawford, Anglin, 
Stevens et al., 2016), and when analyzing and interpreting results there 
are a number of researcher degrees of freedom available that can produce 
inaccurate, but desired conclusions (Simonsohn, Nelson, & Simmons, 
2014; Wicherts et al., 2016). 
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Glorification of p < .05: “It Was Published, Therefore It Is a Fact” 

Scientism refers to exaggerated faith in the products of science (Haack, 
2012; Pigliucci, 2018). One particular manifestation of scientism is reifica¬ 
tion of a conclusion based on its having been published in a peer-reviewed 
journal. These arguments are plausibly interpretable as drawing an equiva¬ 
lence between “peer-reviewed publication” and “so well established that 
it would be perverse to believe otherwise” (for examples, see, e.g., Fiske, 
2016; Jost et al., 2009). They are sometimes accompanied with sugges¬ 
tions that those who criticize such work are either malicious or incompe¬ 
tent (Fiske, 2016; Jost et al., 2009; Sabeti, 2018), and thus reflect this sort 
of scientism. Especially because ability to cite even several peer-reviewed 
publications in support of some conclusion does not make the conclusion 
true, this is particularly problematic (see, e.g., Flore & Wicherts, 2015; 
Jussim, 2012; Jussim, Crawford, Anglin, Stevens et al., 2016; Simonsohn 
et al., 2014). 

One of the most important gatekeepers for an article entering a peer- 
reviewed journal is a statistically significant result, or p < .05 (Simmons, 
Nelson, & Simonsohn, 2011). The undue reification of “peer reviewed” as 
“fact” itself implies a reification ofp < .05, to the extent thatp < .05 is a nec¬ 
essary finding to get some empirical work published (Nuijten, Flartgerink, 
van Assen, Epskamp, & Wicherts, 2016). Elere is a list of conclusions that 
are not justified by p < .05: 

1 The researcher’s conclusion is an established fact. 

2 The main findings are reliable or reproducible. 

3 The difference or relationship observed is real, valid, or bona fide. 

4 The difference or relationship observed cannot be attributed to chance. 

In fact, the only thing p < .05 might establish, as typically used, is that 
the observed result, or one more extreme, has less than a 5% chance of 
occurring, if the null is true. Even that conclusion is contingent on both 
the underlying assumptions not being too severely violated, and on the 
researcher not employing questionable research practices to reach p < .05 
(Simmons et al., 2011). 

It gets worse from there. P-values between .01 and .05 are improb¬ 
able if the effect under study is truly nonzero (Simonsohn et al., 2014). 
When a series of studies produces a predominance of p-values testing the 
key hypotheses in this range, it is possible that the pattern of results obtained 
(despite reaching p < .05) is more improbable than are the obtained results 
under the null for each study. Consider a three-experiment sequence where 
one degree of freedom F-tests of the main hypothesis, with error degrees of 
freedom of 52, 50, and 63, have values of 5.34, 4.18, and 4.78, respectively, 
and correspond to effect sizes ranging from d = .55 to .64. The correspond¬ 
ing p-values are .025, .046, and .033, respectively. If we assume an average 
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underlying effect size of d = .60, the probability of getting three values 
between .01 and .05 is itself .014 (this probability can be easily obtained 
from the website http://rpsychologist.com/d3/pdist). 

In other words, the likelihood of getting this pattern of results, with 
a true effect size of d = .60, is even more improbable than are obtaining 
those results under the null. This is not some concocted hypothetical. It 
is exactly the results reported in one of the most influential papers in all 
of social psychology, the first paper to produce evidence that stereotype 
threat undermines women’s math performance; a paper that, according 
to Google Scholar, has been cited over 3,000 times (Spencer, Steele, & 
Qumn, 1999). 

There are two bottom lines here. Treating conclusions as facts because 
they appear in peer-reviewed journals is not justified. Treating findings as 
“real” or “credible” simply because they obtained p < .05 is not justified. 
Some claims in some peer-reviewed articles are justified and some statistical 
findings do provide strong evidence in support of some claim. Excess sci¬ 
entism occurs, however, when the quality of the evidence, and the strength 
of the conclusions reached on the basis of that evidence, are not critically 
evaluated, and, instead, the mere fact of publication and p < .05 are pre¬ 
sented as or presumed to be a basis for believing some claim is true. 


Status Quo and Status Biases 

Status Quo Biases 

Laypeople are prone to metacognitive myopia (see Fielder, Chapter 7 this 
volume), and are often biased toward maintaining the current scientific con¬ 
sensus on a topic (Samuelson & Zeckhauser, 1988). Moreover, people often 
hold a false belief in small numbers, erroneously believing that a sample is 
representative of the population and that a study is more likely to repli¬ 
cate than the laws of chance would predict (Tversky & Kahneman, 1971). 
Seminal studies may thus be perceived as holding an exaggerated level of 
truth. 

Does metacognitive myopia impact social psychologists? There are good 
reasons to think it does. When a paper, or finding, achieves canonical status 
it may be widely accepted by social psychologists as “truth." It can be quite 
difficult to change the canon once some finding has been published and 
integrated into common discourse in the field (Jussim, Crawford, Anglin, 
Stevens et al., 2016). This is so even when stronger contradictory evidence 
emerges (Jussim, 2012). Papers that challenge accepted or preferred conclu¬ 
sions in the literature may be held to a higher threshold for publication. For 
example, replication studies regularly report samples much larger than the 
original study (see Table 15.1), suggesting they have been held to a higher 
methodological and evidentiary standard. 


Table 15A Social psychology bias for the status quo? 
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This may, in part, result from repeated citations of the “canonical” find¬ 
ing, as mere repetition can increase the subjective truth of a message (see 
e.g., Myers, Chapter 5 this volume; Unkelbach & Koch, Chapter 3 this 
volume). This repetition-truth could be particularly potent in cases where 
the “canonical” finding is consistent with a preferred narrative in the field. 
Indeed, there may be a number of zombie theories remaining in psychology 
despite substantial and sustained criticism (e.g., Meehl, 1990), as even when 
an article is retracted, scientists continue to cite it (Greitemeyer, 2014). 
When the original authors acknowledge that new evidence invalidates 
their previous conclusions, people are less likely to continue to believe the 
overturned findings (Eriksson & Simpson, 2013). However, researchers do 
not always declare they were wrong, even in the face of evidence to the 
contrary. 


Status Biases 

One of the great arguments for the privileged status of science is universal- 
ism (Merton, 1942/1973); scientific claims are supposed to be evaluated 
on the basis of the quality of the evidence rather than the status of the 
person making the claim. The latter can be referred to as a status bias and it 
may play a role in influencing scientists’ perceptions and interpretations of 
research. Sometimes referred to as an eminence obsession (Vazire, 2017), 
or the “Matthew Effect” (Merton, 1968), the principle underlying status 
bias is that the “rich get richer.” Having a PhD from a prestigious univer¬ 
sity, currently being employed by a prestigious university, and/or having an 
abundance of grant money, awards, publications, and citations, are used as a 
heuristic for evaluating work. That is, the work of scientists fitting into one 
or more of these categories frequendy may get a pass, and be evaluated less 
critically (Vazire, 2017). 

Empirically, status biases have been demonstrated in a variety of aca¬ 
demic contexts. Peer reviewers for a prominent clinical orthopedic journal 
were more likely to accept, and evaluated more positively, papers from 
prestigious authors in their field than identical papers evaluated under 
double-blind conditions (Okike, Hug, Kocher, & Leopold, 2016). In the 
field of computer science research, conference paper submissions from 
famous authors, top universities, and top companies were accepted at a 
significantly greater rate by single-blind reviewers than those who were 
double-blind (Tomkins, Zhang, & Heavlin, 2017). Peters and Ceci (1982) 
demonstrated a similar effect on publishing in psychology journals, rein¬ 
forcing the self-fulfilling nature of institutional-level stereotypes. 

Evidence of Scientific Gullibility 

Thus far we have defined scientific gullibility, articulated standards for dis¬ 
tinguishing scientific gullibility from simply being wrong, reviewed basic 
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standards of evidence, and reviewed the evidence regarding potential social 
psychological factors that lead judgments to depart from evidence. But is 
there any evidence of actual scientific gullibility in social psychology? One 
might assume that scientific gullibility occurs rarely among social psycholo¬ 
gists. We are in no position to reach conclusions about how often any of 
these forms of gullibility manifest, because that would require performing 
some sort of systematic and representative sampling of claims in social psy¬ 
chology, which we have not done. Instead, in the next section, we take a 
different approach. We identify examples of prominent social psychological 
claims that not only turned out be wrong, but that were wrong because sci¬ 
entists made one or more of the mistakes we have identified. In each case, 
we identify the original claim, show why it is likely erroneous, and discuss 
the reasons this should have been known and acknowledged. 


Conclusions Without Data: The Curious Case of Stereotype 
“Inaccuracy” 

Scientific articles routinely declare stereotypes to be inaccurate either with¬ 
out a single citation, or by citing an article that declares stereotype inaccuracy 
without citing empirical evidence. We call this “the black hole at the bot¬ 
tom of declarations of stereotype inaccuracy” (Jussim, Crawford, Anglin, 
Chambers et al., 2016), and give some examples: “[Stereotypes are mala¬ 
daptive forms of categories because their content does not correspond to 
what is going on in the environment” (Bargh & Chartrand, 1999, p. 467). 
“To stereotype is to allow those pictures to dominate our thinking, lead¬ 
ing us to assign identical characteristics to any person in a group, regardless 
of the actual variation among members of that group” (Aronson, 2008, p. 
309). No evidence was provided to support either claim. 

Even the American Psychological Association (APA), in its official pro¬ 
nouncements, has not avoided the inexorable pull of this conceptual black 
hole. APA first declares: “Stereotypes ‘are not necessarily any more or less 
inaccurate, biased, or logically faulty than are any other kinds of cognitive 
generalizations,’ and they need not inevitably lead to discriminatory con¬ 
duct” (APA, 1991, p. 1064). They go on to declare: “The problem is that 
stereotypes about groups of people often are overgeneralizations and are either 
inaccurate or do not apply to the individual group member in question ([Heilman, 
1983], note 11, at 271)” (emphasis in original). 

The APA referenced Heilman (1983), which does declare stereotypes to 
be inaccurate. It also reviews evidence of bias and discrimination. But it 
neither provides nor reviews empirical evidence of stereotype inaccuracy. 
A similar pattern occurs when Ellemers (2018, p. 278) declares, “Thus, if 
there is a kernel of truth underlying gender stereotypes, it is a tiny kernel” 
without citing scholarship that assessed the accuracy of gender stereotypes. 

These cases of claims without evidence regarding inaccuracy pervade 
the stereotype literature (see Jussim, 2012; Jussim, Crawford, Anglin, 
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Chambers et al., 2016, for reviews). It may be that the claim is so common 
that most scientists simply presume there is evidence behind it — after all, 
why would so many scientists make such a claim, without evidence? (see 
Duarte et al., 2015; Jussim, 2012; Jussirn, Crawford, Anglin, Chambers 
et al., 2016; Jussim, Crawford, Anglin, Stevens et al., 2016, for some possible 
answers). Given this state of affairs, it seems likely that when the next pub¬ 
lication declares stereotypes to be inaccurate without citing any evidence, 
it, too, will be accepted. 


Large Claims, Small Samples 

Studies with very small samples rarely produce clear evidence for any con¬ 
clusion; and, yet, some of the most famous and influential social psycho¬ 
logical findings are based on such studies. Social priming is one example of 
this. One of the most influential findings in all of social psychology, prim¬ 
ing elderly stereotypes causing people to walk more slowly (Bargh, Chen, 
& Burrows, 1996, with over 4,000 citations as of this writing), was based 
on two studies with sample sizes of 30 each. It should not be surprising 
that forensic analyses show that the findings of this and similar studies are 
extraordinarily unlikely to replicate (Schimmack, Heene, & Kesavan, 2017), 
and that this particular study has been subject to actual failures to replicate 
(Doyen, Klein, Pichon, & Cleeremans, 2012). 

A more recent example involves power posing, the idea that expansive 
poses can improve one’s life (Carney, Cuddy, & Yap, 2010). That is an 
extraordinarily confident claim for a study based on 42 people. It should not 
be surprising, therefore, that most of its claims simply do not hold up under 
scrutiny (Simmons & Simonsohn, 2017) or attempts at replication (Ranehill 
et al., 2015). 


Failure to Eliminate Experimenter Effects 

Experimenter effects occur when researchers evoke hypothesis-confirming 
behavior from their research participants, something that has been well 
known for over 50 years (e.g., Rosenthal & Fode, 1963). Nonetheless, 
research suggests that only about one-quarter of the articles in Journal of 
Personality and Social Psychology and Psychological Science that involved live 
interactions between experimenters and participants explicidy reported 
blinding those experimenters to the hypotheses or experimental conditions 
(Jussim, Crawford, Anglin, Stevens et al., 2016; Klein et al., 2012). 

Although it is impossible to know the extent to which this has created 
illusory support for psychological hypotheses, it is not impossible for this 
state of affairs to lead to a high level of skepticism about findings in any 
published report that has not explicitly reported experimenter blindness. 
This analysis is not purely hypothetical. In a rare case of researchers cor¬ 
recting their own research, Lane et al. (2015) reported failures to replicate 
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their earlier findings (Mikolajczak et al., 2010, same team). They noted that 
experimenters had not previously been blind to condition, which may have 
caused a phantom effect. Research has also demonstrated that some priming 
“effects” occurred only when experimenters were not blind to condition 
(Gilder & Heerey, 2018). Much, if not all, social psychological experimen¬ 
tation that involves interactions between experimenters and participants, 
and that fails to blind experimenters, warrants high levels of skepticism, 
pending successful (preferably pre-registered) replications that do blind 
experimenters to hypothesis and conditions. Based on content analysis of 
the social psychological literature (Jussim, Crawford, Anglin, Stevens et al., 
2016; Klein et al., 2012), this may constitute a large portion of the social 
psychological experimental literature. 


Inferring Causation from Correlation 

Inferring causality from correlation happens with regularity in psychology 
(e.g., Nunes et al., 2017), and, as we show here, in work on intergroup 
relations. Gaps between demographic groups are routinely presumed to 
reflect discrimination, which, like any correlation (in this case, between 
group membership and some outcome, such as distribution into occupa¬ 
tions, graduate admissions, income, etc.), might but does not necessarily 
explain the gap. For example, when men receive greater shares of some 
desirable outcome, sexism is often the go-to explanation (e.g., Ledgerwood, 
Haines, & Ratliff, 2015; van der Lee & Ellemers, 2015), even when alter¬ 
native explanations are not even considered (Jussim, 2017b). Sometimes, 
it is the go-to explanation even when an alternative explanation (such as 
Simpson’s paradox) better explains the discrepancy (e.g., Albers, 2015; 
Bickel, Hammel, & O’Connell, 1975). 

Similarly, measures of implicit prejudice were once presented as pow¬ 
erful sources of discrimination (e.g., Banaji & Greenwald, 2013) based 
on “compelling narratives.” The logic seemed to be something like (1) 
implicit prejudice is pervasive, (2) inequality is pervasive, (3) therefore, 
implicit prejudice probably explains much inequality. We call this a 
“phantom” correlation because the argument could be and was made in 
the absence of any direct empirical link between any measure of implicit 
prejudice and any real-world gap. Indeed, even the more modest goal of 
linking implicit prejudice to discrimination has proven difficult (Mitchell, 
2018). It should not be surprising, therefore, to discover that evidence 
indicates that implicit measures predict discrimination weakly at best (e.g., 
Forscher et al., 2016). 

Furthermore, evidence has been vindicating the view proposed by 
Arkes and Tetlock (2004) that implicit “bias” measures seem to reflect 
social realities more than they cause them (Payne, Vuletich, & Lundberg, 
2017; Rubinstein, Jussim, & Stevens, 2018). Thus, although it may well be 
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true that there is implicit bias, and it is clearly true that there is considerable 
inequality of all sorts between various demographic groups, whether the 
main causal direction is from bias to inequality, or from inequality to “bias” 
remains unclear. This seems like an example of scientific gullibility, not 
because the implicit bias causes inequality link is known to be “wrong,” 
but because dubious and controversial evidence has been treated as the 
type of well-established “fact” appropriate for influencing policy and law 
(Mitchell, 2018). 

Overlooking Contrary Scholarship 

The “power of the situation” is one of those canonical, bedrock “findings” 
emblematic of social psychology. It is true that there is good evidence that, 
sometimes situations are quite powerful (Milgram, 1974). But the stronger 
claim that also appears to have widespread acceptance is that personality 
and individual differences have little to no effect once the impact of the sit¬ 
uation is accounted for (see e.g., Jost & Kruglanski, 2002; Ross & Nisbett, 
1991). The persistence of an emphasis on the power of the situation in 
a good deal of social psychological scholarship provides one example of 
overlooking scholarship that has produced contrary evidence (Funder, 
2006, 2009). 

There are many problems with this claim, but with respect to scientific 
gullibility the key one is that it is usually without actually comparing the 
“power of the situation” to evidence that bears on the “the power of indi¬ 
vidual differences.” The typical effect size for a situational effect on behavior 
is about the same as the typical effect size for a personality characteristic - and 
both are rather large relative to other social psychological effects (Fleeson, 
2004; Fleeson & Noftle, 2008; Funder, 2006, 2009). It is not “gullibility” for 
those to believe in the “power of the situation” simply based on ignorance 
of the individual differences data. It is gullibility to make such claims without 
identifying and reviewing such evidence. 


The Fundamental Publication Error: Correctives do not Necessarily 
Produce Correction 

The fundamental publication error refers to the belief that just because 
some corrective to some scientific error has been published, that there has 
been scientific self-correction (Jussim, 2017a). A failure to self-correct can 
occur, even if a corrective has been published, by ignoring the correction, 
especially in outlets that are intended to reflect the canon. With most of 
the examples presented here, not only are the original claims maintained 
by violation of fundamental norms of scientific evidence, but ample cor¬ 
rections have been published. Nonetheless, the erroneous claims persist. 
Despite the fact that dozens of studies have empirically demonstrated the 
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accuracy of gender and race stereotypes, claims that such stereotypes are 
inaccurate still appear in “authoritative” sources (e.g., Ellemers, 2018; see 
Jussim, Crawford, & Rubinstein, 2015 for a review). Similarly, the assump¬ 
tion that inequality reflects discrimination, without consideration of alterna¬ 
tives, is widespread (see, e.g., reviews by Hermanson, 2017; Stem, 2018; 
Winegard, Clark, & Hasty, 2018). 

Table 15.1 shows how studies that have been subject to critiques and 
failed pre-registered replications continue to be cited far more frequently 
than either the critiques or the failed replications, even after those critiques 
and failures have appeared. Although blunt declarations that situations are 
more powerful than individual differences are no longer common in the 
social psychological literature, the emphasis on the power of the situation 
manifests as blank slatism and as a belief in “cosmic egalitarianism” — the 
idea that, but for situations, there would be no mean differences between 
any demographic groups on any socially important or valued characteristics 
(Pinker, 2002; Winegard et al., 2018). Thus, the examples presented here 
are not historical oddities; they reflect a state of scientific gullibility in social 
psychology. 

Reducing Scientific Gullibility 

Changing Methods and Practices 

Some researchers are actively working on ways to reduce gullibility and 
increase valid interpretations of published findings, many of which are aimed 
at reforming the academic incentive structure. Simply put, within academia, 
publications represent credibility and currency. The more a researcher pub¬ 
lishes, and the more those publications are cited by others in the field, the 
more their credibility as a researcher increases. This can then lead to more 
publications, promotions, and funding opportunities. Thus, publishing 
one’s findings is essential, and one of the most prominent gatekeepers of 
publication is the p<.05 threshold. Yet, such a metric can promote ques¬ 
tionable research practices (Simmons et al., 2011; Simonsohn et al., 2014). 
These findings may constitute an example of Goodhart’s Law — that when 
a measure becomes a desirable target it ceases to become a good measure 
(Koehrsen, 2018) — at work among researchers. 

One intervention aimed at reducing behaviors that artificially increase 
the prevalence of p-values just below 0.05 is preregistration. Preregistration 
requires a researcher to detail a study’s hypotheses, methods, and pro¬ 
posed statistical analyses prior to collecting data (Nosek & Lakens, 2014). 
By pre-registering a study, researchers are not prevented from performing 
exploratory data analysis, but they are prevented from reporting exploratory 
findings as confirmatory (Gelman, 2013). 

Because of growing recognition of the power of pre-registration to 
produce valid science, some journals have even begun embracing the 
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registered report. A registered report is a proposal to conduct a study with 
clearly defined methods and statistical tests that is peer reviewed before 
data collection. Because a decision to publish is made not on the nature 
or statistical significance of the findings, but on the importance of the 
question and the quality of the methods, publication biases are reduced. 
Additionally, researchers and journals have started data-sharing reposito¬ 
ries to encourage the sharing of non-published supporting material and 
raw data. Openly sharing methods and collected data allows increased 
oversight by the entire research community and promotes collaboration. 
Together, open research materials, preregistration, and registered reports 
all discourage scientific gullibility by shedding daylight on the research 
practices and findings, opening studies to skeptical evaluation by other 
scientists, and therefore, increasing clarity of findings and decreasing the 
influence of the types status and status quo biases discussed earlier. 


Benefits of Intense Skepticism 

Extraordinary claims should require extraordinary evidence. Thus, sub¬ 
jecting scientific claims to intense, organized skepticism and scrutiny is 
necessary to sift unsubstantiated claims from ones justified and well sup¬ 
ported. Such organized skepticism is one of the core norms of science 
(Merton, 1942/1973). Indeed, people are better at identifying flaws in 
other people’s evidence-gathering than their own (Merrier & Sperber, 
2011), and a dissenting minority within a group can reduce conformity 
pressures on decision-making (Crano, 2012), producing deeper thought 
that can lead to higher-quality group decisions (Nemeth, Brown, & 
Rogers, 2001). Science is a collective enterprise, where the independ¬ 
ent operations of many accumulate into a bigger picture. Making high- 
quality group decisions (e.g., regarding what constitutes the canonical 
findings) is therefore important, and one way to do so is to subject scien¬ 
tific research to intense skepticism and scrutiny by other members of the 
scientific community. 


The Evolutionary Psychology of Gender Differences: A Case Study in the 
Benefits of Intense Skepticism 

One area of research that has received an intense amount of skepticism, 
scrutiny, and criticism from social psychologists, is the idea of evolved 
gender differences in the psychological and behavioral characteristics of 
human males and females (Geher & Gambacorta, 2010; Pinker, 2002; 
von Hippel & Buss, 2018). One common criticism often leveled against 
evolutionary psychology is that it is a political effort led by conservatives, 
emphasizing biological determinism, to advance a political agenda that 
defends current social arrangements and inequalities (for a more elaborate 
discussion of these criticisms, see Pinker, 2002; Tybur & Navarrete, 2018). 
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The premise on which this is based - that evolutionary psychologists are 
primarily conservative — has been disconfirmed. Surveys of evolutionary 
psychologists reveal they are as liberal, if not more, than their colleagues 
(Tybur, Miller, & Gangestad, 2007; see von Hippel & Buss, 2018 for 
a review). 

More importantly for our discussion of scientific gullibility is that evo¬ 
lutionary psychologists have been clear for decades that their approach 
emphasizes an interaction between genes and the sociocultural environ¬ 
ment. For instance, in his landmark study on mate preferences, Buss (1989, 
p. 13, emphasis added) noted the following: “Currently unknown are the 
cultural and ecological causes of variation from country to country in (1) the 
magnitudes of obtained sex differences, and (2) the absolute levels of valuing 
reproductively relevant mate characteristics.” It is quite difficult to detect 
even a whiff of biological determinism in that statement, as it implies a 
need to research the cultural and ecological causes of variation. This study 
has been cited over 4,000 times and was a featured paper in Behavioral and 
Brain Sciences that was accompanied by a number of responses. To continue 
to imply that evolutionary psychology emphasizes biological determinism 
suggests that the critics are either (a) unaware of one of the most important 
papers in evolutionary psychology; (b) are aware of it, but have not read 
it; or, (c) are aware of it, have read it, and have decided to still insist the 
approach emphasizes biological determinism. 

Nevertheless, despite the (ongoing) controversy (see, e.g., Galinsky, 
2017), the level of controversy and mutual skepticism (between advocates 
and opponents of evolutionary psychology explanations for gender differ¬ 
ences) has helped advance social psychology’s understanding of gender. 
Meta-analyses and large sample studies (N >10,000) from different theo¬ 
retical perspectives have investigated gender differences within and across 
cultures (see Stevens & Haidt, 2017). A collaborative effort by researchers 
with different research backgrounds, and in some cases adversarial perspec¬ 
tives, concluded that there are important gender differences between males 
and females that influence cognition and behavior, which result from a com¬ 
plex interaction of innate (i.e., biological) factors and the sociocultural environment 
(Halpern et al., 2007). 

Intense skepticism — of purely cultural explanations for sex differences and 
of purely biological ones - has been a boon to the scientific research seek¬ 
ing to understand those differences. A similar skepticism directed especially 
to the canonical claims in social psychology could be most productive - are 
they based on any evidence? Are they based on a handful of small N stud¬ 
ies? Have there been any successful pre-registered replications? Have they 
explicitly considered, and ruled out, alternative explanations? All research, 
but especially foundational research, should be subject to this sort of skepti¬ 
cism, at least if we want to reduce scientific gullibility and increase scientific 
support for our field’s major claims. 
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Strong Inference 

Strong inference involves two main strategies that are synergistic, and that, 
when used together, offer considerable promise to limit scientific gullibility 
and produce rapid scientific advances (Platt, 1964; Washburn & Skitka, in 
press). The two strategies involve (1) seeking conditions that might discon- 
firm one’s predictions and (2) comparing theories or hypotheses that make 
alternative or opposing predictions in some research context. Platt (1964, 
p. 350) also speculated on obstacles to the use of strong inference: 

The difficulty is that disproof is a hard doctrine. If you have a hypothesis 
and I have another hypothesis, evidently one of them must be elimi¬ 
nated. The scientist seems to have no choice but to be either soft-headed 
or disputatious. Perhaps this is why so many tend to resist the strong 
analytical approach - and why some great scientists are so disputatious. 

Nonetheless, strong inference can reduce gullibility by making use of one 
of the few known antidotes to all sorts of biases: consider the opposite (Lord, 
Lepper, & Preston, 1984). If, for example, a field has a theoretical bias (see 
e.g., Funder, 1987; Jussim, 2012) or political biases (Duarte et al., 2015), 
then scientific literature may become filled with lots of evidence providing 
weak and biased tests seeming to confirm certain notions. Combine this 
with excessive scientism, and one has a recipe for gullibility on a grand scale, 
because few scientists will dive into the individual studies in sufficient depth 
to debunk them. 

However, adoption of strong inference can and has limited such biases. 
Washburn and Skitka (in press) review several cases where strong inference 
was used to minimize political biases. For example, one can adopt what they 
call a “negative test strategy”: hypothesize the opposite of what one prefers. 
If liberals generally prefer evidence of liberal superiority, a liberal social sci¬ 
entist could add in hypotheses about conservative superiority. Interestingly, 
when this was done with respect to prejudice, the long-standing claim that 
liberals were generally less prejudiced than conservatives was disconfirmed, 
replaced by the understanding that overall levels of prejudice are similar, but 
directed towards different groups (Brandt, Reyna, Chambers, Crawford, 
& Wetherell, 2014). Similarly, for example, Rubinstein et al. (2018) used 
strong inference to compare perspectives emphasizing the power of stereo¬ 
types versus individuating information to bias implicit and explicit person 
perception. Perspectives emphasizing the power of individuating informa¬ 
tion were supported, thereby limiting bias in favor of bias. 

Credibility Categories 

Recently, Pashler and De Ruiter (2017) proposed three credibility 
classes of research. Class 1, the most credible, is based on work that has 
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been published, successfully replicated by several pre-registered studies, 
and in which publication biases, HARKing (Kerr, 1998), and p-hacking 
can all be ruled out as explanations for the effect. Work that meets this 
standard can be considered a scientific fact, in the Gouldian sense of 
being well established. Class 2 research is strongly suggestive but falls 
short of being a well-established “fact.” It might include many published 
studies, but there are few, if any, pre-registered successful replications, 
and HARKing and p-hacking have not been ruled out. Class 3 evi¬ 
dence is that yielded by a small number of small sample studies, with¬ 
out pre-registered replications, and without checks against HARKing 
and p-hacking. Such studies are preliminary and should not be taken as 
providing strong evidence of anything, pending stronger tests and pre¬ 
registered successful replications. 

Pashler and De Ruiter’s (2017) system could have prevented social psy¬ 
chology from taking findings such as stereotype threat (Steele & Aronson, 
1995), social priming (Bargh et al., 1996), and power posing (Carney et al., 
2010) as “well established.” Had the field not had a norm of excessive scient¬ 
ism, and, instead, treated these findings as suggestive, and warranting large- 
scale pre-registered replication attempts, much of the current “replication 
crisis” may have been avoided. To be fair, the value of pre-registration was 
not widely recognized until relatively recently, which may help explain why 
it was not used. But our main point remains intact; absent pre-registration, 
or large, high-powered replications, such work should have been considered 
preliminary and suggestive at best, especially considering the small sample 
sizes on which it was based. 

Pashler and De Ruiter’s (2017) system is an important contribution to 
understanding when past literature in social psychology provides a strong 
versus weak evidentiary basis for or against some theory, hypothesis, or 
phenomenon. Nonetheless, we also think it is less important that research¬ 
ers use this exact system, than it is that they develop some systematic way 
of assigning credibility to research based on factors such as sample size, 
consideration of alternative explanations, pre-registration, open data, and 
materials, etc. In fact, the field’s view of how to evaluate research cred¬ 
ibility is still evolving, and Pashler and De Ruiter’s system is not the final 
word; in fact, it is more like an initial attempt to systematize strength of 
past evidence. Whatever system one uses, we predict that a closer atten¬ 
tion to the credibility of research, rather than a simple acceptance of some¬ 
thing as fact just because it was published, will go a long way to reducing 
scientific gullibility. 

Conclusion 

Scientific gullibility is a major problem because it has contributed to the 
development of a dubious scientific “canon” — findings that are taken as 
so well estabhshed that they are part of the social psychological funda¬ 
ment, as evidenced by their endorsement by the American Psychological 
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Association, and their appearance in outlets that are supposed to reflect only 
the most well-established phenomena, such as handbook and annual review 
chapters. Gullibility begins with treating results from small sample size stud¬ 
ies as well established “facts,” a lack of transparency surrounding data analy¬ 
sis, failure to understand limitations of statistical analyses, underestimation of 
the power of publication biases, or an over-reliance on p<.05. Researchers 
also sometimes give undue credibility to papers that oversell findings, tell 
compelling narratives that aren’t substantiated by the data, or report data 
that support desired conclusions with insufficient skepticism. Findings that 
have been roundly refuted or called into question in the empirical literature 
are often not extirpated from the canon. 

In this chapter, we articulated and provided evidence for six scientific 
gullibility red flags that can and do appear in the research literature: (1) large 
claims being made from small and/or potentially unrepresentative samples, 
(2) many published reports of experiments do not state that experimenters 
were blind to hypotheses and conditions, (3) correlational data being used 
as evidence of causality, (4) ignoring scholarship articulating clear oppos¬ 
ing evidence or arguments, (5) putting forth strong claims or conclusions 
that lack a foundation in empirical evidence, and (6) neglecting to consider 
plausible alternative explanations for findings. Although we are not claiming 
that the whole social psychological literature reflects gullibility, it is also true 
that little is currently of sufficient quality to fall into Pashler and de Ruiter’s 
(2017) class 1 of “established fact.” On the other hand, we see no evidence 
of consensus in the field to use their system. Absent some such system, 
however, it remains unclear which areas of social psychology have produced 
sound science and established facts, and which have been suggestive at best 
and entirely false at worst. Our hope is that by revealing these influences on, 
standards for recognizing, and ways to limit scientific gullibility, we have 
contributed something towards social psychology producing a canon that is 
based on valid and well-justified claims. 
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Gullibility and the Envelope of Legitimacy 

We consider gullibility to be an uncomfortable feeling state precipitated 
by the perception that one has been persuaded to believe something that 
is not true. The experience is not only uncomfortable, it is threatening to 
one’s sense of self-worth. Accordingly, people will undergo considerable 
effort to avoid and reduce it. A viable method of avoidance is to believe 
that something false is true rather than believe that we have been duped. In 
the vernacular, we may “double down” on our belief, becoming even more 
certain that the position held is true. 

We do not expect every communicative act to be entirely truthful, but 
we do expect that communication will lie within a reasonable distance of 
the truth. This reasonable distance is what we call the “envelope of legiti¬ 
macy.” It is our contention that, if one is persuaded to believe a position 
that lies outside the envelope of legitimacy and subsequendy learns that the 
communication was untrue, this is when one is likely to feel the unpleasant 
tension state of gullibility and to double down on one’s false belief. In short, 
people would rather believe that a lie is true than believe that they were 
duped — if that lie falls outside the envelope of legitimacy. In the succeeding 
sections, we will develop the conceptual underpinnings for this idea. Then 
we will discuss our recent empirical work concerning factors affecting the 
current political beliefs of individuals who voted in the 2016 U.S. presiden¬ 
tial election. 

An Infamous Case of Gullibility 

On the evening before Halloween, 1938, Orson Welles began his weekly 
radio broadcast with the disclaimer that the Mercury Theater would present 
a dramatization of H. G. Wells’ War of the Worlds. By the time his broadcast 
had ended, hundreds of thousands of American listeners were seized with 
panic as they tried to flee monsters from the planet Mars. In the dramatiza¬ 
tion, listeners heard what was portrayed as a series of news bulletins. One of 
the bulletins described unusual explosions on Mars while another indicated 
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that there had been a disturbance in a field in the small town of Grover’s 
Mill, New Jersey, where a “huge flaming object” had landed. A CBS news 
reporter and a Princeton University astronomy professor allegedly raced to 
the scene to describe that monsters too hideous to describe were emerging 
from the object. Within the next few minutes, the monsters had decimated 
the state police and were in full control of the area. The National Guard was 
called and it, too, proved no match for the objects. 

The consequences of the great deception were brief but spectacular. It 
was estimated that 6 million listeners heard the broadcast and that at least 
1 million believed that Martians had invaded the United States (Cantril, 
1940). They believed that Martians had been sighted in many major cit¬ 
ies across the country and that New York City itself had been wiped from 
the Earth. People cried, screamed, and prepared for the end. Mr. William 
Dock was famously photographed with his shotgun, ready to do battle with 
any Martian that dared attack his farm. Others got into their cars to drive 
as far away as they possibly could, while still others huddled with loved 
ones to await their ends. “We all kissed one another and felt we would 
all die,” admitted one respondent. The reaction was not confined to any 
educational, geographic or racial group. The New York Times reported that 
that in several communities, physicians showed up at hospitals to help care 
for the injured, and college students sped along highways to spend their last 
moments with their families. 

Orson Welles’ broadcast underscored the plausibility of the implausible. 
Not only was the program’s premise a fantasy, but Welles had clearly stated 
that the Mercury Theater was a drama. The program itself was rife with 
internal inconsistencies of time and space. Nonetheless, it caused more than 
a million people to become frightened, many of whom took action to flee 
from the Martian menace. During the ensuing decades, commentators have 
speculated on the gullibility of the audience with a concern for whether 
such gullibility could lead to a future bout of mass hysteria. 

Toward an Operational Definition of Gullibility 

The Oxford Dictionary defines gullibility as the tendency to be easily 
persuaded. Jussim, Stevens, Honeycutt, Anglia, and Fox (Chapter 15 this 
volume) add, “easily deceived or cheated.” These definitions imply that 
extreme persuasibility is the property of the individual. It is sometimes seen 
as synonymous with naivete or foolishness (Rotter, 1980). Viewed as an 
element of personality, it should transcend time and situation. The implica¬ 
tion of this perspective is that people who are gullible are generally easy to 
persuade or deceive. They are the kinds of people who believe what they 
are told not only about creatures invading from other planets but about 
most anything conveyed to them by authority. They believe in seances 
and believe political rhetoric that emanates from the pens or mouths of 
populist leaders. However, the search for personality variables in persuasion 
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has proved elusive (Cooper, Blackman, & Keller, 2016), and the search for 
reliable individual differences in the degree of gullibility has been no excep¬ 
tion (Mercier, 2017). Rotter (1980), for example, examined the relation¬ 
ship between gullibility and interpersonal trust and could find no systematic 
evidence that reliable individual differences in trust were related to people’s 
tendency to believe statements that most people would see as untrue 

Mercier (2017) views gullibility as source-based rather than a character¬ 
istic of certain impressionable people. He maintains that gullibility emanates 
from the undue influence of “focal sources, often authority figures, be they 
religious leaders, demagogues, TV anchors or celebrities” (Mercier, 2017, 
p. 104). Such focal sources may be gifted orators, as in the case of Adolf 
Hitler, or they may make use of seemingly simple communicative tech¬ 
niques, such as repetition, a hallmark of Donald Trump’s oratory style (see 
Myers, Chapter 5 this volume; Unkelbach & Koch, Chapter 3 this volume, 
for discussions of repetition and its relation to gullibility). Certainly, history 
is replete with communicators who had the ability to convince masses to 
believe propaganda that, in retrospect, facilitates our using the term gullible 
to describe their falling prey to the communicators’ messages. From Huey 
Long to Adolf Hitler, communicators have had the special charisma, power, 
and the ability to persuade. 

Another conceptualization considers gullibility to be a faulty response to 
a persuasive communication (see also Fiedler’s discussion of metacognitive 
myopia, Chapter 7 this volume). In this view, gullibility is conceptualized as 
believing someone’s communication despite good evidence that the person 
should not be believed (Rotter, 1980). The gullible audience simply fails to 
consider reasons for disbelief. This might be conceptualized as the differ¬ 
ence between inhabiting a gullible mindset versus inhabiting a skeptical one, 
especially as a primary, default process (Mayo, Chapter 8 this volume). It is 
the basis of the phenomenon known as the Barnum effect (Meehl, 1956), 
whereby individuals give high accuracy ratings to descriptions of their per¬ 
sonalities that supposedly are tailored specifically to them but that are, in 
fact, vague and general enough to apply to a wide range of people. People 
fail to notice that the statements are at a level of abstraction that makes them 
applicable to almost anyone. 

Even when people do check the trustworthiness of the source and the 
information, persuasion that we can call gullibility occurs. In the response 
to the War of the Worlds broadcast, almost everyone who Cantril (1940) 
interviewed and those who were quoted in newspapers around the coun¬ 
try made an attempt to check the veracity of the information. One per¬ 
son reported looking out of her window and seeing traffic on the street. 
“They all must be fleeing the invasion,” she reported. Another person 
looked out of his window and saw no traffic at all on his street. “The roads 
must be clogged on account of the Martians,” he concluded. Another per¬ 
son quickly tuned to another of his favorite stations. He heard static. He 
concluded that the Martians had knocked the station off the air. Another 


Gullibility and the Envelope of Legitimacy 307 

listener turned his dial to find corroboration. He heard church music. 
“They all must be praying,” he thought. 

We may be better able to identify gullibility than define it. When large 
numbers of people fall for an implausible assertion, we have little trouble 
identifying it as an instance of gullibility. Almost all newspapers on the morn¬ 
ing of October 31, 1938, used terms like duped and gullible to describe the 
hysteria and the widespread belief that creatures from the planet Mars had 
landed. Why? Because the untruthful premise was so outrageous that people 
found it difficult to identify discontinuing evidence. Although people may 
have checked for corroborating evidence, many ultimately accepted the 
premise that the Martians had landed. The only question left was what to do 
about it. As some of the reactions to the War of the Worlds broadcast attest, it 
is difficult to be certain of how to disconfirm the assertion (see van Prooijen, 
Chapter 17 this volume). And disconfirmation may be more difficult as the 
assertion becomes more outrageous. As Adolf Hitler mused in Mein Kampf, 

People will believe a big he sooner than a little one; and if you repeat 
it frequently enough people will sooner or later believe it ... In the 
big lie, there is always a certain force of credibility . . . they fall victim 
to the big lie since they themselves often tell small lies but would be 
ashamed to resort to large-scale falsehoods. It would never come into 
their heads to fabricate colossal untruths and they would not believe 
that others could have the impudence to distort the truth so infamously. 

(Hitler, 1935, vol. 1, ch. X) 


Gullibility as an Internal State 

We view gullibility as a specific response to a persuasive communication. 
We view it as an internal state - an uncomfortable feeling state that is prompted 
by the perception that one has been persuaded to believe something that is not true. 
Not all persuasion results in the feeling of gullibility, even when people 
realize they have been misled. The feeling of gullibility is associated with 
the magnitude of the untruth but is not isomorphic with it. It is also associ¬ 
ated with source and communication characteristics but is not identical to 
those variables either. Let us consider a more mundane circumstance than 
being persuaded that the Earth was invaded by Martians. Consider a person 
persuaded to believe the veracity of a television commercial that promised 
that a new vitamin supplement would produce 15 pounds of weight loss in 
a single week. Convinced of the extraordinary impact the supplement could 
have on his life, a consumer purchases the tablet, only to find that it has no 
effect whatsoever. Our consumer may or may not feel gullible as a result 
of his being persuaded to believe the unlikely proposition of 15 pounds 
of weight loss in a week. Under some circumstances, the consumer may 
feel disappointed in the outcome but nonetheless conclude that the pur¬ 
chase was a reasonable one, even if it was unlikely to further his weight-loss 
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goal. He might vow not to believe a similar communication in the future, 
become annoyed with the radio station that aired the commercial or vow 
never to believe a person wearing a white lab coat in an infomercial. 

On the other hand, being persuaded to purchase the unlikely pill may 
cause the individual to experience the unpleasant tension state of gullibility. 
This person believes that his own sense of self-esteem has been implicated. 
His experience is self-directed. Good and worthy people do not fall for 
schemes. Good and worthy people do due diligence. They check the cred¬ 
ibility of the source, the reasonableness of the claims, and/or the evidence 
that the claim is valid. This person may use terms like, “I fell for it,” to 
describe his belief in the advertiser’s claims. The experience is unpleasant, 
aversive, and motivates him to reduce it. 

People who listened to the War of the Worlds broadcast responded in 
many different ways. Some disbelieved in the first instance, realizing they 
had been listening to a drama. Some were angry. Still others viewed their 
being persuaded as their own fault. It is this reaction that we term gullibil¬ 
ity. Mr. T. Owen Miller of Washington, DC, captured this view of gul¬ 
libility when he said, “I admit that I am one of the many thousands who 
showed incredible stupidity, lack of nerve and ignorance while listening to 
Mr. Welles’ broadcast.” 


Gullibility and Dissonance 

The claim that gullibility is an aversive, unpleasant reaction to having been 
persuaded is akin to the feeling of cognitive dissonance that occurs in the 
presence of inconsistent cognitions. Like dissonance, gullibility is a condi¬ 
tion that people seek to reduce. At the operational core of gullibility is 
one’s having been persuaded to believe something, or to do something, 
only to find that what one was led to believe is false. One way to reduce 
felt gullibility is to accept the improbable belief as true. In the vernacular, 
you “double down” on your belief, becoming even more certain that it is a 
true and valid position (see Dunning, Chapter 12 this volume). The person 
who bought his miracle diet cure, and who feels gullible as a result of its not 
working, comes to believe that it is actually working. He may even take 
action to lose weight in other ways in order to avoid the unpleasant feeling 
of gullibility. The person who believed that Martians had landed will have 
a difficult time doubling down on that belief. . . but he still may try. One 
woman from Newark, New Jersey, reported running from her apartment, 
hoping to drive to her mother’s house before the Martians destroyed the 
city. When she arrived at the street, a man told her that he had heard an 
announcement that it was all a hoax. She refused to believe him and told 
him to “start praying.” 

Among the most well-known examples of gullibility in the psychologi¬ 
cal literature is the reaction of the group of people who believed that the 
world would end in a cataclysmic flood. It was arguably the first research 
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specifically designed to test the implications of cognitive dissonance theory 
(Festinger, Riecken, & Schachter, 1956). Members of the group were per¬ 
suaded by its founder that the end of the world was imminent and that 
beings from the planet Clarion would descend to Earth on a rocket ship to 
whisk the true believers to safety while the rest of the planet was destroyed 
by the flood. This preposterous communication from Clarion was alleg¬ 
edly delivered to the group by automatic writing, using the founder as a 
medium. The true believers — known as the Seekers — included people from 
all walks of life, including educated professionals. They had been persuaded 
by what they thought was automatic writing from Clarion to believe that 
the world would end. In dramatic fashion, they prepared for the world’s end 
and awaited the arrival of the spaceship from Clarion that would save them 
from destruction. 

The evidence that they had been wrong was obvious. The morning fol¬ 
lowing the expected cataclysm dawned with no destruction and no space¬ 
ship. The feeling of tension must have been palpable. How could they 
live with the shame of believing the preposterous story? How could they 
deal with their feelings of gullibility? We believe that people take steps to 
reduce their experience of gullibility. They convince themselves that they 
had not been duped after all. Just as our weight supplement consumer tried 
to convince himself that the supplement he took really was working, the 
group of cataclysm believers found a way to convince themselves that they 
had not been wrong after all. In their well-known response to the discon- 
firmation, the group received a new message from planet Clarion: “That 
this little group sitting so long shined so much light upon the world, that 
God has decided to save the Earth from destruction.” And they “doubled 
down.” They did not shrink back to their homes with the knowledge that 
they had been deceived. To the contrary, they shouted their “success” for 
all to hear. They sent out press releases, wrote flyers, and talked to whoever 
would listen to make sure that the entire world would learn that they had 
been correct in their beliefs. 

The Envelope of Legitimacy 

We do not always feel gullible when we are persuaded to believe. An 
editorial may extol the virtues of a particular piece of legislation or a par¬ 
ticular candidate. A celebrity may tell us that he eats a “breakfast cereal of 
champions” and an economist from the conservative Freedom Foundation 
may present convincing arguments for a reduction in corporate tax rates. 
The arguments in these persuasive messages may convince us, may fail to 
convince us, or may convince us temporarily. We may be persuaded in 
the short term, but return to our original beliefs over time. Despite being 
persuaded to believe something that we ultimately feel is not correct, we 
do not ordinarily feel gullible. We do not experience the unpleasant state 
of gullibility. 
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In broad terms, people are aware of two seemingly incompatible prin¬ 
ciples. On the one hand, in social discourse, we presume that people are 
telling us the truth (Grice, 1975). The social world would be difficult to 
navigate if people’s utterances were independent of their truth value. In 
evolutionary social psychology, scholars have argued that the tendency to 
believe and trust what others assert appears to be an evolutionary universal, a 
highly adaptive feature of humans in ancestral societies, where (1) the world 
was relatively stable and slow-changing and (2) most communications came 
from intimately known others within a primary group whose trustworthi¬ 
ness was known (see Acedo-Carmona & Gornila, 2015). Trusting others 
seems to be a powerful evolutionary inclination. 

Paul Grice (1975) laid out a number of principles or maxims that people 
use in civil discourse with each other. In his “maxim of quality,” Grice 
pointed out that a speaker is presumed to be speaking the truth and not 
knowingly communicating information that the speaker knows to be false. 
At the same time, most of us do tolerate a degree of dishonesty and dissimu¬ 
lation under certain circumstances. A person might compliment a colleague 
on his new tie, without fully meaning it. The athlete with his picture on 
the “breakfast of champions” cereal box might not actually enjoy or eat 
it. Candidates for public office may describe their virtuous deeds, but we 
would not be surprised to find that it is exaggeration or hyperbole. We 
hold a degree of healthy skepticism (see Mayo, Chapter 8 this volume) that 
allows us to recognize that not all statements are completely true. 

Grice’s maxim of quality and the principle of healthy skepticism cir¬ 
cumscribe an envelope of legitimacy. It is our contention that people feel 
gullible when they are persuaded to believe something that lies outside 
the envelope of legitimacy. Inside the envelope are positions that are true 
or that do not stray too far from the truth. A student’s statement that she 
maintained an A average in college when, in fact, she had only earned an 
A— is more likely to lie inside the envelope of legitimacy than if she had 
only maintained a C average. In addition to the magnitude of distance 
from the truth, the social circumstances also contribute to what is inside 
or outside the envelope of legitimacy. A person who expresses an opinion 
about his wife’s new suit is expected to be truthful if she is going for a job 
interview but may have greater flexibility if she is deciding what to wear 
for a casual engagement. 

As another example, consider communicative acts in the realm of poli¬ 
tics. Newspaper reporters are expected to be veridical in their articles, and 
thus they have a small envelope of legitimacy. News “commentators,” 
given the context of their reporting and the expectations for commentary 
and opinion pieces, have a wider envelope of legitimacy. It may further be 
the case that political candidates have even wider envelopes when they are 
engaged in political campaigning. Thus, the same statement may be within 
the envelope of legitimacy when made by a political candidate, on the bor¬ 
der of the envelope when made by a news commentator, and outside the 
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envelope when made by a newspaper reporter. In short, the envelope of 
legitimacy will vary as a function of the context, which includes at least the 
platform from which the statement is made and the type of communicator. 
While we do not expect every communicative act to be entirely truthful, 
we do expect that communication will lie within a reasonable distance of 
the truth given the communicative context. If we are persuaded to believe 
a position that lies outside the envelope of legitimacy for a particular com¬ 
municator in a particular circumstance, and subsequently leam that the 
communication was untrue, this is when we are likely to feel the unpleas¬ 
ant tension state of gullibility. 


Approximating the Size of the Envelope of Legitimacy 

In the original conceptualization of cognitive dissonance, Festinger (1957) 
held that two cognitions were in a dissonant relationship if one cognition 
followed from the obverse of the other. A perplexing aspect of that con¬ 
ceptualization was how to determine when two cognitions were truly dis¬ 
sonant. Was there a way to determine how discrepant one cognition needed 
to be from another cognition in order for it to arouse dissonance? If a U.S. 
citizen believed in the right to bear arms but made a statement advocating 
a ban on assault rifles, are the two cognitions discrepant? If so, are they suf¬ 
ficiently discrepant to arouse dissonance? 

Fazio, Zanna, and Cooper (1977) proposed a resolution to determine 
the degree of discrepancy that is needed for two cognitions to be psycho¬ 
logically inconsistent. Based on prior classic work by Sherif, Sherif, and 
Nebergall (1965) on latitudes of acceptance and rejection, Fazio and col¬ 
leagues (1977) proposed that people have their own latitudes when it comes 
to discrepancy. Participants were asked to identify positions on a variety 
of issues that they believed were acceptable (latitude of acceptance) or not 
acceptable (latitude of rejection) in light of their own position on the issues. 
As predicted, the unpleasant feeling of cognitive dissonance occurred only 
when participants advocated for positions that were outside of their own 
latitudes of acceptance, regardless of whether they were on the same side of 
the midpoint of the issue. 

We believe that the envelope of gullibility is a conceptually similar con¬ 
struct. People have their own conceptions of the degree to which a commu¬ 
nicator can violate the maxim of quality. Some amount of dissimulation is 
acceptable, even if not desirable. Beyond that latitude fall utterances whose 
degree of falsehood lies in an unacceptable range. A person feels gullible 
when he or she believes the communication that lies in the latitude of rejec¬ 
tion. A person who claims on his resume to have been a university gradu¬ 
ate when in fact he dropped out after freshman year would most likely be 
perceived to have made a statement outside of the envelope of legitimacy. 
The perceiver experiences gullibility when he or she believes the statement 
and ultimately realizes that it is not true. 
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The Motivation to Protect Against Gullibility 

We are proposing that gullibility is an unpleasant feeling and that people 
will undergo considerable effort to avoid and reduce it. We are proposing 
that people would rather believe that a lie is true than believe that they 
were duped, if that lie falls outside the envelope of legitimacy. Why should 
this be so? Elliot Aronson wrestled with this question when he commented 
on the motivational roots of cognitive dissonance. Why should people be 
upset when they act inconsistendy with their beliefs? Rather than main¬ 
taining that people are hardwired to reject inconsistency, Aronson (1968) 
believed that cognitive dissonance is an experience that implicates the self 
as unworthy. People generally think that they are good and decent people 
and have a reasonably positive self-concept. Good and decent people should 
say what they believe and believe what they say. Only a “schnook” would 
engage in dissonant behavior. And most people do not think of themselves 
as schnooks (Aronson, 1999). According to Aronson, at the very heart of 
dissonance theory are people trying to maintain a sense of self-worth that 
had been brought into question by dissonant behavior. 

Stone and Cooper (2003) amplified this view especially in conditions in 
which personal self-standards are made salient. They found that when the 
self was made salient, people responded to inconsistency by protecting their 
sense of self-esteem. The more their self-esteem was compromised by their 
inconsistent behavior, the more dissonance they experienced — that is, they 
changed their attitudes to protect their self-worth. As Dunning (Chapter 12 
this volume) and Myers (Chapter 5 this volume) imply, the ultimate source 
of our gullibility is often ourselves. 

In summary, the experience of gullibility occurs when people discover 
that they have believed a statement that lies outside the envelope of legiti¬ 
macy and that the statement was not true. The limits of the envelope of 
legitimacy will depend on the circumstances of the untruth, including an 
assessment of the communicator, the communication, and the importance 
of the act. Because gullibility is threatening to people’s sense of self-worth, 
it is experienced as an unpleasant state of tension that people try to avoid 
or reduce. Rather than diminishing its importance, one way people reduce 
the aversive experience of gullibility is by convincing themselves that the 
lie is true. 


Empirical Research 

Gullibility in the Era of Donald Trump 

Donald Trump surprised the pundits when he squeaked to an Electoral 
College victory in the 2016 U.S. presidential election. He survived as a 
candidate despite publicity that would have ended the campaigns of most 
candidates. Allegations of sexual assault rolled off his back, his own Planet 


Gullibility and the Envelope of Legitimacy 313 

Hollywood admissions of his crude sexual attitudes and behavior did not 
derail his candidacy nor did the coarse and demeaning language with which 
he castigated his opponents. 

Although he entered the presidency on January 21, 2017 with the lowest 
popularity rating of any president in modem times, his behavior continued 
to spiral downward in ways that would sink the electoral careers of most 
politicians. Anyone who voted for Trump expecting him to “pivot” and 
become more “presidential” had to be disappointed by the President’s first 
year in office. But Trump’s popularity has not shown much change, despite 
his unpopular stances on immigration, his partial embrace of white nation¬ 
alists in Charlottesville, Virginia, or his reference to the countries of Latin 
America and Africa as “s***holes.” 

“I could stand in the middle of Fifth Avenue and shoot somebody and 
I wouldn’t lose any voters,” said candidate Trump during the 2016 pri¬ 
maries. It appears he may be right. 1 A Quinnipiac poll taken in February 
2018 showed that people had the same impression of Trump’s leadership 
and personal characteristics after his tumultuous first year in office as they 
had before the presidential election. Despite his inflammatory public state¬ 
ments, people did not see him as any less moral than they had prior to the 
election. Republican voters in particular saw the President as highly moral, 
giving him the same 65% approval on that dimension that they had given 
him prior to the election. 

Many voters cast their ballots for Donald Trump because they believed 
he was an effective deal maker. He could get things done. His failure to pass 
health care legislation, his inability to secure funding for his infamous wall 
(especially from Mexico) — neither stopped people from reporting (in the 
same poll) that they saw him as an equally strong leader now as they did 
when he told the public of his extraordinary deal-making skills. 

We suspect that many of the people who supported Donald Trump 
in the election felt gullible after a year of inconsistency between what 
he had promised and what he had accomplished. People who voted for 
Trump knew of his history of being a showman, a TV personality, a 
businessman whose casinos struggled financially, and whose “university” 
failed to educate students. Nonetheless, they made their choice, hoping 
that his deeds as president would match his rhetoric. When his deeds did 
not match the rhetoric, Trump voters risked feeling as gullible as Orson 
Welles’ radio audience. 

One of the specific promises that characterized nearly every one of can¬ 
didate Trump’s campaign rallies was his pledge to build a 2,000-mile wall 
along the U.S. border with Mexico — paid by Mexico. There is ample 
reason to be skeptical that this promise will ever come to fruition, includ¬ 
ing the consistent and not surprising reaction of the Mexican government. 
We suggest that the Mexican wall promise is a statement that lies outside 
most people’s envelope of legitimacy. Our analysis suggests that, precisely 
because the promise of the wall lies outside the envelope of legitimacy, 


314 Joel Cooper and Joseph J. Avery 

many Trump voters will continue to believe it will be built. They will 
attempt to avoid the unpleasant feeling of gullibility by denying all evi¬ 
dence. They may double down and become even more convinced that the 
United States will build, and Mexico will pay for, the wall across the border. 

In the current research, we predict that citizens in the United States who 
voted for Donald Trump are more likely to believe the campaign promises 
that have very little likelihood of coming true. The more outlandish the 
promises, the less likely they are to come true, but the more likely they are 
to be believed by people who made the decision to vote for Trump. 

We also believe that people differ in how concerned they are about gul¬ 
libility. Although most people are sensitive to feeling gullible, we believe 
that there is a dimension such that some people are extremely concerned 
while others are less so. Accordingly, we predict that people who voted for 
Trump will steadfasdy believe in his campaign promises, including the least 
likely ones. Importandy for our theory, this effect will be greatest in those 
who are most sensitive to the aversive feeling of gullibility. 

To test this, we asked participants to answer a series of questions, includ¬ 
ing two questions designed to assess gullibility sensitivity: “I get upset when I 
find out that something I was led to believe is not true,” and “It’s an uncom¬ 
fortable feeling to learn that someone I trusted deceived me.” Both were 
scored on a five-point Likert scale. Participants then were asked to indicate, 
again on five-point Likert scales, the extent of their current belief in four 
campaign promises made by Donald Trump during 2016, when was he was 
then-Candidate Trump. The promises included: (1) “A wall between the 
United States and Mexico will be built,” (2) “Obamacare will be repealed,” 
(3) “China will be declared a currency manipulator,” and (4) “The carried 
interest tax loophole will be eliminated.” Participants also were asked to 
indicate, on a five-point Likert scale, the extent of their current belief in a 
promise that had been made neither by Donald Trump nor Hillary Clinton 
(“Marijuana will be made 100% legal”). Lastly, participants were asked to 
indicate, on a -7 to 7 scale, their approval of Trump prior to the 2016 elec¬ 
tion and their approval of Trump at the time of the survey (May 2018). 

Our population included 425 participants from Amazon’s Mechanical 
Turk. Of these, 225 had voted for Hillary Clinton in the 2016 U.S. 
Presidential Election, and 200 had voted for Donald Trump. The mean age 
(± SD) of the participants was 37.3 ± 13.3 years. The population was 45% 
male and 55% female. Most participants (greater than 78%) were white. 

Absolute means accorded with commonsense expectations: 2016 app¬ 
roval of Trump was 4.18 for Trump voters and —5.22 for Clinton voters 
(Welch two-tailed t-test, p < .001). The 2018 approval of Trump was 3.65 
for Trump voters and -5.33 for Clinton voters (Welch two-tailed t-test, 
p < .001). Belief in the four policy positions was 3.51 for Trump voters 
and 2.49 for Clinton voters (Welch two-tailed t-test, p < .001). Across all 
participants, Cronbach’s alpha for the four policy items was .74. For the 
gullibility sensitivity measure, which was comprised of the two gullibility 
items, Cronbach’s alpha was .60. 
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As predicted, there was a significant two-way interaction of voter type 
(Trump vs. Clinton) and gullibility sensitivity on belief in the four policy 
items (p = .03). For Trump voters, belief in the four policies showed a mar¬ 
ginally significant positive correlation with gullibility sensitivity (p = .07, 
P = .12, R-squared = .02) (Figure 16.1). Those Trump voters who found 
feelings of gullibility to be upsetting were also more likely to believe that 
Trump’s campaign promises were still going to come true. For Clinton vot¬ 
ers, there was not a statistically significant relationship between gullibility 
sensitivity and belief in the four Trump policy promises (p = .20, P = — .11, 
R-squared = .007), with the trend even being negative (Figure 16.1). 

It is important to show that people who are sensitive to gullibility are 
not merely predisposed to believe any proposal. Their increased belief is 
restricted to policies that they were led to believe by the candidate for 
whom they voted. Accordingly, we asked people for their support for a pol¬ 
icy to legalize marijuana, which had not been endorsed by either candidate. 
As expected, for this item, the interaction effect entirely disappeared, with 
both Trump and Clinton voters showing the same trend. The two-way 
interaction of voter type and gullibility sensitivity on belief in the policy 
item was not significant (p = .87). For Trump voters, belief in the item was 
negatively correlated with gullibility sensitivity and the effect was not sig¬ 
nificant (p = .33, P = —.12, R-squared = .005), and the same was the case for 
Clinton voters (p = .25, P = —.15, R-squared = .006) (Figure 16.2). 

Our results also were as predicted when we considered the approval 
ratings for Trump as a function of gullibility sensitivity. There was a 



Figure 16.1 Plots of models of beliefs that President Trump’s campaign promises will 
come true and sensitivity to the aversive feeling of gullibility (N = 425). 
The shaded regions are the 95% confidence intervals. 














316 Joel Cooperand Joseph J. Avery 


Clinton Voters 


c 

o 

'(f) 

s. 

>* 

o 

I 

■O 

0 


03 

c 

3 


0 

0 

CO 


4 - 


3- 



2 - 


1 2 


3 


4 


5 


Trump Voters 


c 

o 

'</> 

£ 

>* 

o 

1 

T3 

a> 


ra 

c 

D 


.2 

a3 

m 



4 


3 


2 


1 


2 


3 


4 


5 


Gullibility Sensitivity 


Gullibilty Sensitivity 


Figure 16.2 Plots of models of belief in a policy position that was not endorsed 
by either Donald Trump or Hillary Clinton (N = 425). The shaded 
regions are the 95% confidence intervals. 


significant two-way interaction of voter type and gullibility sensitivity 
on both pre-election and post-election approval ratings. Beginning with 
pre-election approval ratings, the two-way interaction of voter type and 
gullibility sensitivity to 2016 approval ratings was significant (p < .001). 
Trump voters who showed greater sensitivity to gullibility also showed 
greater approval of Trump ((3 = .25), although the effect failed to reach 
significance (p = .26) (Figure 16.3). For Clinton voters, the relationship 
between gullibility sensitivity and Trump approval was negative (p < .001, 
P =-1.42) (Figure 16.3). 

As with the pre-election approval ratings, for 2018 approval ratings, the 
two-way interaction of gullibility sensitivity and vote cast to 2018 approval 
ratings was significant (p = .02). Trump voters who showed greater sen¬ 
sitivity to gullibility showed no meaningful change in approval of Trump 
(p = .95, P = .02). For Clinton voters, the relationship between gullibility 
sensitivity and Trump approval was negative (p < .001, P = —1.01). 

Overall, our results provide consistent evidence that, compared with 
Flillary Clinton voters, Donald Trump voters who exhibited greater sen¬ 
sitivity to the unpleasant tension state of gullibility were significantly more 
likely to believe that Trump’s campaign promises, including ones that 
seemed increasingly unlikely, would come true. A similar pattern held 
for approval ratings, thus supporting the proposition that voters who are 
more sensitive to the aversive feeling of gullibility are also more likely to 
double down on their belief in and support for the candidate for whom 
they voted. 
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Figure 16.3 Plots of models of approval ofDonald Trump in 2016 (pre-election) 
and sensitivity to the aversive feeling of gullibility (N = 425). The 
shaded regions are the 95% confidence intervals. 


Conclusion 

We believe that gullibility is a feeling state akin to the affective state of cogni¬ 
tive dissonance. It is negative, unpleasant, and needs to be reduced. People 
experience gullibility when they realize that they have believed a proposition 
that was untrue and that the belief fell outside the envelope of legitimacy. On 
some occasions, people have no choice but to accept their gullibility. The 
listeners who believed Orson Welles’ War of the Worlds broadcast eventually 
had to face the incontrovertible realization that Martians had not invaded 
our planet. However, many instances of false belief in a persuasive message 
leave room for ambiguity (see Strack, Chapter 9 this volume). Reduction of 
gullibility results in the ironic increase in a version of the original belief with 
an accompanying belief in the veracity of the communicator. The continued 
belief in the conspiracy of fake news may be an illustration of this phenom¬ 
enon as those who seek to avoid gullibility deny evidence that potentially 
contradicts their beliefs. It is possible, further, that such behavior is adaptive, 
necessary for the flourishing of long-term relationships, including political 
ones (Baumeister, Maxwell, Thomas, & Fox, Chapter 2 this volume). 

We conclude by wondering if there is a window of time after which 
people will face their own gullibility. Can we continue to believe that a 
proposition is true even if the passage of time produces no evidence of its 
truth value? If the Mexican wall is never built, will people who sought 
to avoid gullibility eventually decide that dealing with truth is better than 
avoiding gullibility? This is a proposition for future testing. 
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Note 

1 And that he may be aware of some of the underlying psychological forces at work. 
As Krueger,Vogrincic-Haselbacher, and Evans (Chapter 6 this volume) point out, 
”[T]he term fake news has been popularized by politicians who themselves hold 
dubious records of truthfulness.” 
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17 Belief in Conspiracy Theories 

Gullibility or Rational Skepticism? 

Jan-Willem van Prooijen 

VU AMSTERDAM 


Conspiracy theories are widespread in our society. Surprisingly large 
numbers of citizens believe allegations that the Moon landings were 
filmed in a TV studio, that humans created the HIV virus in the lab, and 
that the 9/11 terrorist strikes were an inside job of the U.S. government 
(e.g., Douglas, Sutton, & Cichocka, Chapter 4 this volume; Sunstein 
& Vermeule, 2009; van Prooijen, 2018). Conspiracy theories are com¬ 
monly defined as assumptions about a group of actors that colludes in 
secret agreement to reach goals widely seen as evil (Bale, 2007). While 
conspiracy theories sometimes turn out to be true (e.g., the Iran-Contra 
scandal), quite often conspiracy theories are implausible in light of logic 
or scientific evidence, and therefore deviate from mainstream narratives. 
People who strongly believe conspiracy theories hence are highly skep¬ 
tical of regular news sources and official readings of events, and often 
proclaim to be rational human beings who “just ask questions.” A quali¬ 
tative analysis of interviews with citizens active in the Dutch conspiracy 
milieu reveals that believers actively reject the qualification “conspiracy 
theorist,” and prefer to see themselves as “critical freethinkers” that posi¬ 
tively distinguish themselves from “the sheeple,” 1 who are gullible and 
easily manipulated by powerholders (Harambam & Aupers, 2017). This 
self-perception as a critical and rational thinker is underscored by the fol¬ 
lowing quote, which is drawn from a conspiracist website (www.sheep 
killers.com) explicitly focused on protecting, and opening the eyes of, 
“the sheep” who supposedly are led astray by the powerful and immoral 
leaders that rule our nations: “If you think 9/11 was the result of cave¬ 
dwelling terrorists attacking our country, bringing down airplanes with 
box-cutters and collapsing entire buildings into their footprints, you 
really are a sheep.” 

How rational is the tendency to believe conspiracy theories? Looking 
at the specific contents of a range of conspiracy theories, one needs to 
acknowledge how well crafted, complex, and creative many conspiracy the¬ 
ories are. For instance, conspiracy theories about the 9/11 terrorist strikes 
often assume that not the impact of the planes but controlled demolition 
made the Twin Towers collapse. These theories are based on scientifically 
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grounded arguments about the steel construction of the Twin Towers, the 
temperatures at which steel melts (about 2,750 °F) and the maximum tem¬ 
peratures reached by burning kerosene (about 1,500 °F). 2 Even extremely 
far-fetched conspiracy theories are remarkably well designed. For instance, 
the flat-earth movement endorses the theory that our planet Earth is in fact 
flat, and that the public has been deceived for over 400 years by scientists 
and world governments to believe that the earth is round (or, to be more 
precise, somewhat oval). Their arguments include detailed accounts of how 
NASA routinely manipulates or fabricates satellite pictures, testimonies of 
airplane pilots who confirm to not see the Earth’s curvature at high altitude, 
and technical descriptions of how airplane windows are designed to provide 
a perceptual illusion of a curving Earth. 

While in the present contribution I will not seriously examine the con¬ 
tents of these conspiracy theories (I am comfortable asserting here that the 
impact of the planes and the fires that subsequently erupted caused the col¬ 
lapse of the Twin Towers on 9/11, and that the Earth is round albeit not 
perfectly so), I will seriously consider two opposing hypotheses about the 
social psychology of conspiracy theories. The first hypothesis is that, as sug¬ 
gested above, belief in conspiracy theories is grounded in a mindset charac¬ 
terized by rational skepticism. According to this view, people who believe 
conspiracy theories are indeed “critical freethinkers” who do not take offi¬ 
cial readings of events for granted, but instead carefully and independently 
collect and examine evidence to form their own objective judgments. Then- 
conclusions may sometimes be wrong (just like scientists sometimes make 
honest mistakes when interpreting research data), but the epistemic process 
through which believers construct or accept conspiracy theories is delibera¬ 
tive, analytic, and utilizes the approach of a “lay scientist.” I refer to this idea 
as the rational conspiracist hypothesis. 

The second and alternative hypothesis, however, is that belief in conspir¬ 
acy theories is grounded in a mindset characterized by gullibility. According 
to this view, people construct or accept conspiracy theories through System 
1 processes including heuristics, emotions, and intuitive thinking (see also 
Myers, Chapter 8 this volume; Unkelbach & Koch, Chapter 3 this volume). 
A deep-rooted distrust in power holders or other groups leads believers to 
reflexively reject official accounts of impactful events, and to uncritically 
accept implausible conspiracy theories. Through motivated reasoning and the 
confirmation bias, believers subsequently justify their suspicious sentiments 
by selectively embracing evidence that supports their theory and rejecting 
evidence inconsistent with it, providing the illusion of a well-elaborated and 
irrefutable argument. I refer to this idea as the gullible conspiracism hypoth¬ 
esis. In the following, I review the psychological literature on conspiracy 
theories to test these two competing hypotheses. I will specifically examine 
the empirical relationships of belief in conspiracy theories with (1) a range 
of implausible beliefs that do not involve conspiracies, (2) cognitive biases, 
(3) stereotyping, and (4) cognitive style. 
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Belief in Conspiracy Theories 

Although conspiracy theories vary widely in content, the tendency to 
believe them is grounded in similar underlying psychological processes. 
This insight is consistent with the finding that the single best predictor 
of belief in one conspiracy theory is belief in a different conspiracy the¬ 
ory (Abalakina-Paap, Stephan, Craig, & Gregory, 1999; Goertzel, 1994; 
Swami et al., 2011; Wood, Douglas, & Sutton, 2012). These findings are 
often interpreted as evidence that people differ in the extent to which they 
have a conspiratorial mindset that predisposes them to attribute impact¬ 
ful societal events to the deliberate actions of hostile conspiracies (e.g., 
van Prooijen & van Dijk, 2014). Relatedly, people differ structurally in 
their “conspiracy mentality,” that is, an individual difference variable 
designed to assesses people’s tendency to perceive a world full of conspira¬ 
cies (Imhoff & Bruder, 2014). Furthermore, belief in conspiracy theories is 
highly susceptible to contextual factors. For instance, conspiracy theories 
gain momentum particularly following impactful societal crisis events (van 
Prooijen & Douglas, 2017). These insights have contributed to the study 
of belief in conspiracy theories as a growing research field in the social 
sciences (for overviews, see Douglas et al., Chapter 4 this volume; van 
Prooijen, 2018; van Prooijen & van Vugt, 2018). 

To assess the two competing hypotheses put forward in this chapter, here 
I propose more specific predictions that can be tested through a review of the 
empirical research literature. If the rational conspiracist hypothesis is true, 
it stands to reason that people who believe conspiracy theories are rational, 
or at least not irrational, in many other perceptual or cognitive domains. In 
particular, based on the rational conspiracist hypothesis one would expect 
that belief in conspiracy theories is either unrelated or negatively related 
with (a) implausible beliefs that do not involve conspiracies, such as beliefs 
in the paranormal, superstition, and pseudoscience; (b) cognitive biases that 
are well known to produce irrational judgments and decision-making; and 
(c) stereotyping, which involves mental simplifications and overgeneraliza¬ 
tions of social categories. As to cognitive style (d), conspiracy beliefs should 
be positively related with a tendency to recognize the complexity of dif¬ 
ficult problems. Furthermore, analytic thinking, and not intuitive thinking, 
should stimulate belief in conspiracy theories. 

If the gullible conspiracist hypothesis is true, however, one would 
expect that to the extent people believe conspiracy theories more strongly, 
they are more likely to (a) also believe implausible beliefs that do not 
involve conspiracies, (b) display cognitive biases, and (c) engage in ste¬ 
reotyping. In their cognitive style (d), conspiracy beliefs should predict 
a tendency to perceive difficult problems in an oversimplified fashion; 
moreover, analytic thinking should predict skepticism of conspiracy theo¬ 
ries instead of belief in them. I will now assess the empirical evidence for 
these two competing hypotheses. 
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Conspiracy Theories and Implausible Beliefs 

How is belief in conspiracy theories related with a range of implausible 
beliefs that are common, that do not involve conspiracies, and that are not 
supported by any evidence? Various studies examined the relationships 
between conspiracy beliefs and supernatural beliefs, such as superstition 
and belief in paranormal phenomena. These studies typically find a reliable 
positive correlation: The more strongly people believe conspiracy theo¬ 
ries, the more likely it is that they also hold a range of supernatural beliefs. 
For instance, Darwin, Neave, and Holmes (2011) found positive cor¬ 
relations of conspiracy beliefs with beliefs in psi, witchcraft, spiritualism, 
extraordinary life forms, and precognition. Other studies confirm these 
positive relationships. For instance, Lobato, Mendoza, Sims, and Chin 
(2014) found positive correlations between conspiracy beliefs and beliefs 
in the paranormal and pseudoscience. The positive relationships between 
conspiracy beliefs and belief in various supernatural beliefs have been fre¬ 
quently replicated, and are now well established in this research domain 
(e.g., Barron, Morgan, Towell, Altemeyer, & Swami, 2014; Newheiser, 
Farias, & Tausch, 2011; Swami et al., 2011; van Prooijen, Douglas, & De 
Inocencio, 2018). 

An interesting illustration of how conspiracy beliefs are related with 
other implausible beliefs can be found in a seminal paper that introduced 
“pseudo-profound bullshit” and “bullshit receptivity” as viable academic 
terms (Pennycook, Cheyne, Barr, Koehler, & Fugelsang, 2015). Pseudo¬ 
profound bullshit refers to statements that appear to have a deeper meaning 
but actually are empty. Bullshit receptivity refers to people’s tendency to 
perceive such statements as profound, that is, as containing some deeper 
truth. To measure this construct, Pennycook and colleagues (2015) designed 
a scale consisting of statements that are grammatically correct, yet contain 
randomly chosen buzzwords (example items include “Hidden meaning 
transforms unparalleled abstract beauty” and “Good health imparts real¬ 
ity to subtle creativity”). Results revealed that participants’ ratings of such 
statements as profound significantly predicted a range of variables indicative 
of gullibility, including reduced analytic thinking, reduced verbal intelli¬ 
gence, increased paranormal belief, and increased faith in intuition (see also 
Forgas, Chapter 10 this volume). Of importance for the present purposes, 
bullshit receptivity also predicted an increased tendency to believe con¬ 
spiracy theories (Pennycook et al., 2015, study 4). 

The empirical relationships between conspiracy beliefs and such implau¬ 
sible beliefs are not necessarily harmless: Conspiracy theories can lead to 
irrational and harmful behavior. For instance, the link between conspir¬ 
acy theories and belief in pseudoscience has real consequences for peo¬ 
ple’s health. One study reveals that belief in conspiracy theories predicts a 
preference for alternative medicine over regular, evidence-based medical 
approaches (Lamberty & Irnhoff, 2018). Furthermore, in South Africa AIDS 
conspiracy theories are common, which for instance stipulate that AIDS 
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was created by pharmaceutical companies in the lab to sell antiretroviral 
drugs, and that not the HIV virus but these drugs are dangerous to people’s 
health. A study conducted in Cape Town revealed that belief in such AIDS 
conspiracy theories is a major predictor of reduced condom use among both 
men and women (Grebe & Nattrass, 2012). In sum, belief in conspiracy 
theories reliably and consistently predicts a range of implausible beliefs and 
irrational behaviors, which supports the gullible conspiracist hypothesis and 
contradicts the rational conspiracist hypothesis. 

Conspiracy Theories and Cognitive Biases 

The second test of the competing hypotheses put forward here pertains to 
cognitive biases. It is reasonable to assume that people with a truly rational, 
critical mindset less likely fall prey to cognitive biases that deteriorate 
decision-making as compared to people with an irrational, uncritical 
mindset (Myers, Chapter 8 this volume). One cognitive bias of inter¬ 
est is the conjunction fallacy. This is an error in probabilistic reasoning 
characterized by overestimating the likelihood that two events co-occur 
(Tversky & Kahneman, 1983). A well-known example of the conjunction 
fallacy is that after a stereotypical description of a woman being a feminist, 
many people rate the probability that she is a feminist and a bank teller as 
higher than the probability that she is a bank teller. In fact, the statistical 
probability of a combination of two constituents co-occurring (feminist 
and bank teller) can never be higher than the probability of one of the 
individual constituents occurring (bank teller). 

One study investigated the relationships between conspiracy beliefs, par¬ 
anormal beliefs, and conjunction fallacies in a range of judgment domains 
(Brotherton & French, 2014). Specifically, some of the conjunction state¬ 
ments were neutral; some of the conjunction statements were in the context 
of paranormal phenomena (e.g., about a person dreaming her sister’s house 
is on fire, and the sister’s house actually being on fire); and some of the 
conjunction statements involved possible conspiracies (e.g., about CEOs of 
petrol companies discussing the implications of a new device that increases 
fuel efficiency in cars, and the inventor of the device being found dead in 
his home). Results revealed that belief in conspiracy theories predicted an 
increased proportion of conjunction fallacies across judgment domains (i.e., 
neutral, paranormal, and conspiratorial). In fact, although paranormal beliefs 
also predicted increased conjunction fallacies, the effects were stronger for 
conspiracy beliefs across all three types of conjunction contexts. 

A related yet distinct cognitive bias that has been examined in the context 
of conspiracy beliefs is illusory pattern perception. Specifically, the human 
mind automatically and functionally looks for patterns, that is, meaningful 
and causal relationships between stimuli. Detecting the actual causal rela¬ 
tionships between stimuli is important for any organism to adapt to their 
environment, for instance to distinguish friends from foes, edible foods 
from poisons, safe from dangerous situations, and so on. These functional 
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qualities of pattern perception notwithstanding, one consequence of this 
cognitive mechanism is that people often detect non-existing patterns by 
perceiving causal and meaningful relationships between stimuli that are in 
fact unrelated. Such illusory pattern perception for instance predicts habitual 
gambling (Wilke, Scheibehenne, Gaissmaier, McCanney, & Barrett, 2014). 

Of importance to the present purposes, illusory pattern perception posi¬ 
tively predicts belief in conspiracy theories. In a series of studies, partici¬ 
pants’ tendency to perceive patterns in randomly generated strings of coin 
toss outcomes was associated with increased belief in conspiracy theories; 
similar findings were obtained for perceiving patterns in the chaotic mod¬ 
em art paintings by Jackson Pollock (van Prooijen et al., 2018). Moreover, 
a recent study examined participants’ perception of a range of existing, yet 
most likely spurious correlations that occur in everyday life (e.g., an increase 
in chocolate consumption is correlated with an increase in Nobel Prize 
winners in a country). The researchers found that the more strongly par¬ 
ticipants believed that these correlations in fact represented a direct causal 
relationship, the more strongly they believed conspiracy theories (van der 
Wal, Sutton, Lange, & Braga, 2018). 

Pattern perception is generally considered to be one out of two key 
cognitive components of conspiracy beliefs (Shermer, 2011; van Prooijen 
& van Vugt, 2018). The second cognitive component is agency detection: 
The human mind automatically makes a judgment of the intentionality 
behind the actions of others. Were certain outcomes caused by an inten¬ 
tional agent? Like pattern perception, also agency detection is, in principle, 
a functional cognitive mechanism to effectively navigate one’s social world. 
For instance, agency detection smoothes social interaction through increased 
mutual understanding of others’ actions, and helps to make valid judgments 
of accountability when an actor caused harm (van Prooijen, 2018). But 
people also make mistakes in agency detection by perceiving agency where 
none exists. One study assessed to what extent participants detected agency 
in the inanimate geometric figures from the classic Heider and Simmel 
(1944) footage, and found that such hyperactive agency detection predicted 
increased conspiracy beliefs (Douglas, Sutton, Callan, Dawtry, & Harvey, 
2016). Likewise, the related construct of anthropomorphism — that is, the 
tendency to ascribe human qualities to nonhuman stimuli — is positively 
correlated with belief in conspiracy theories (Brotherton & French, 2015; 
Imhoff & Bruder, 2014). In sum, belief in conspiracy theories is reliably 
associated with a range of cognitive biases, specifically the conjunction fal¬ 
lacy, illusory pattern perception, and errors in agency detection. 


Conspiracy Theories and Stereotyping 

By definition, stereotyping is an oversimplification of groups of peo¬ 
ple, and it therefore seems reasonable to assume that a rationally skeptic 
mindset is associated with decreased stereotyping, and that gullibility is 
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associated with increased stereotyping. How does stereotyping relate to 
conspiracy beliefs? One line of evidences comes from research on individ¬ 
ual differences commonly known to reflect increased stereotyping, nota¬ 
bly authoritarianism and social dominance orientation. Research found 
qualified support for the idea that these individual difference variables 
positively predict conspiracy beliefs. Specifically, various studies found a 
positive relationship of these individual difference variables with belief in 
specific conspiracy theories (e.g., the belief that President Kennedy was 
killed by a conspiracy), but no relationship with a generalized tendency 
to perceive a world full of conspiracies (e.g., Abalakina-Paap et al., 1999; 
Swami, 2012). At first blush, the evidence for authoritarianism and social 
dominance orientation as predictors of conspiracy beliefs seems inconsist¬ 
ent. How can this apparent discrepancy between specific versus generic 
conspiracy beliefs be reconciled? 

An important piece of this puzzle is offered in a study by Imhoff and 
Bruder (2014) who investigated conspiracy mentality (i.e., a generic ten¬ 
dency to perceive conspiracies in the world) in relation to authoritarianism, 
social dominance orientation, and stereotyping of a range of specific societal 
groups. These researchers replicated the finding that conspiracy mentality 
is unrelated to these two individual difference variables, but also, offered 
an explanation for this: Authoritarianism and social dominance orientation 
mainly predicts stereotyping of low-power or low-status societal groups, 
such as Muslims, asylum seekers, and gypsies. Conspiracy mentality, in con¬ 
trast, mainly predicts stereotyping of high-power groups, including politi¬ 
cians, managers, big companies, and so on. A series of studies supported 
these ideas, by testing how stereotypes of a range of high-power versus low- 
power groups are related with conspiracy mentality, authoritarianism, and 
social dominance orientation. Furthermore, conspiracy mentality positively 
predicted anti-Americanist and anti-capitalist sentiments in a sample of 
German participants. It thus appears that besides specific conspiracy beliefs 
also a more general conspiracy mentality positively predicts stereotyping, 
but of high-power groups instead of low-power groups. 

One exceptional category in Imhoff and Bruder’s (2014) study was ste¬ 
reotyping of Jewish people (i.e., anti-Semitism), as this variable was posi¬ 
tively correlated with all constructs of interest, that is, conspiracy mentality, 
authoritarianism, and social dominance orientation (see also Swami, 2012). 
Indeed, Jewish conspiracy theories are widespread in the world (e.g., allega¬ 
tions that there is a Jewish plot to attain world domination) and are com¬ 
mon among extremist groups of varying ideological signatures (Bartlett & 
Miller, 2010). Such belief in Jewish conspiracy theories is a major predict of 
anti-Semitism (Golec de Zavala & Cichocka, 2012; Kofta & Sedek, 2005). 
In fact, historians have noted that Jewish conspiracy theories played a major 
role in fueling anti-Semitic sentiments in Nazi-Germany during the 1930s 
and 1940s (e.g., beliefs that a Jewish conspiracy caused the German defeat 
in the First World War; Moreover, Hitler believed that both capitalism and 
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communism were the result of Jewish conspiracies for world domination. 
For details, see Pipes, 1997). 

More generally, it has been noted that believing conspiracy theories 
requires perceivers to ascribe hostile and evil qualities to an out-group - the 
conspiracy - which is facilitated by negative stereotypes of the out-group 
in question (van Prooijen & van Vugt, 2018). It thus seems that conspiracy 
theories go hand in hand with stereotyping of the alleged group of conspira¬ 
tors. General conspiracy mentality predicts stereotyping of the powerful 
groups frequendy implicated in conspiracy theories; likewise, conspiracy 
theories about minority groups predicts stereotyping of the minority group 
in question. Both specific and more general conspiracy beliefs hence posi¬ 
tively predict stereotyping, particularly of groups that are suspected to be 
part of the conspiracy. 

Conspiracy Theories and Cognitive Style 

Presumably the most direct test of the rational versus gullible conspiracist 
hypotheses pertains to how conspiracy believers versus disbelievers differ in 
their cognitive style. I will examine how conspiracy beliefs are related with 
mental simplicity, and more generally how conspiracy beliefs are related 
with System 1 thinking (i.e., intuitive and emotional) versus System 2 
thinking (i.e., deliberative and analytic). As to mental simplicity, one series 
of studies found evidence that political extremism - at both sides of the 
spectrum - predict conspiracy theories (van Prooijen, Krouwel, & Pollet, 
2015). Of interest for the present purposes, two Dutch nationally repre¬ 
sentative samples revealed that these findings were mediated by increased 
beliefs among extremists that there are simple solutions to the complex 
problems that society faces. Consistently, various studies found that higher 
education predicts a decreased likelihood to believe conspiracy theories 
(Douglas et al., 2016) and this relationship is partly mediated by a ten¬ 
dency to perceive simple solutions for complex problems among the lower 
educated (van Prooijen, 2017). Furthermore, conspiracy beliefs are related 
with an illusion of explanatory depth for political issues, that is, people’s 
tendency to overestimate the depth and knowledge of their understanding 
of complex political events (Vitriol & Marsh, 2018). Conspiracy theories 
hence are rooted in a belief that complex societal and political problems 
actually have simple causes and simple solutions. 

A study by Swami, Voracek, Stieger, Tran, and Furnham (2014) experi¬ 
mentally investigated the relationship between analytic thinking and con¬ 
spiracy beliefs. These authors first measured base-rate levels of conspiracy 
thinking, and invited participants back into the lab at a later time. Then, 
in several studies the authors induced manipulations that varied whether 
or not participants were stimulated to think analytically. Results revealed 
that analytic thinking reduced belief in conspiracy theories. Further¬ 
more, intuitive thinking predicted increased belief in conspiracy theories. 
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Correlational findings are consistent with these results. For instance, van 
Prooijen (2017) found that the previously mentioned relationship between 
lower education and increased belief in simple solutions (which in turn 
predicted increased conspiracy beliefs) was mediated by reduced analytic 
thinking. Furthermore, Stahl and van Prooijen (2018) found that a capac¬ 
ity to think analytically in and of itself is insufficient to reduce conspiracy 
beliefs; one also needs to be motivated to be rational and rely on evidence 
to come to informed judgments. These studies all consistently suggest that 
System 2 thinking stimulates skepticism of conspiracy theories instead of 
belief in them. 

If System 2 thinking reduces belief in conspiracy theories, does emotional 
System 1 thinking increase belief in them? Evidence indeed suggests that 
particularly negative emotions increase conspiracy theories. Experimental 
manipulations of lacking control (van Prooijen & Acker, 2015; Whitson & 
Galinsky, 2008), and subjective uncertainty (van Prooijen & Jostmann, 2013; 
Whitson, Galinsky, & Kay, 2015) have been found to increase conspiracy 
beliefs. Correlational evidence supports these experimental findings by 
revealing that conspiracy theories are related with feelings of powerlessness 
(Abalakina-Paap et al., 1999), trait anxiety (Grzesiak-Feldman, 2013), and 
feelings of relative deprivation (van Prooijen, Staman, & Krouwel, 2018). 
Such findings on the role of negative emotions are consistent with histori¬ 
cal observations that conspiracy theories gain momentum among the public 
particularly in the wake of anxiety-provoking societal crisis events, such as 
terrorist attacks, wars, earthquakes, fires, and floods (Brotherton, 2015; Pipes, 
1997; van Prooijen & Douglas, 2017). In sum, the evidence indicates that 
System 1 thinking — emotional, intuitive, and heuristic — promotes belief in 
conspiracy theories. System 2 thinking — analytic, deliberative, and rational — 
promotes skepticism of conspiracy theories. 

Discussion and Conclusion 

The evidence overwhelmingly supports the gullible conspiracist hypothesis 
and contradicts the rational conspiracist hypothesis. The more strongly peo¬ 
ple believe conspiracy theories, the more likely it is that they also endorse 
implausible non-conspiratorial beliefs including paranormal phenomena, 
superstition, pseudo-science, and pseudo-profound bullshit. Furthermore, 
conspiracy beliefs predict an increased susceptibility to a range of common 
cognitive biases, including the conjunction fallacy, illusory pattern percep¬ 
tion, and hyperactive agency detection. Belief in conspiracy theories also 
predict increased stereotyping, particularly of stigmatized minority groups 
that often are accused of conspiracy formation (e.g., Jewish people) as well 
as of powerful groups that are common actors in conspiracy theories (politi¬ 
cians, managers, capitalists, and so on). Finally, conspiracy beliefs are rooted 
in System 1 thinking, not in System 2 thinking. In particular, belief in 
conspiracy theories is associated with lower education levels, a tendency to 


328 Jan-Willem van Prooijen 

perceive complex societal issues as simple, an increased illusion of explana¬ 
tory depth in one’s understanding of political issues, and reduced analytic 
thinking. Instead, intuitive thinking and negative emotions increase belief 
in conspiracy theories. 

The findings reviewed here are hence consistent with a model suggest¬ 
ing that the decision to reject official readings of impactful events, and 
to subsequently embrace conspiracy theories, is often made reflexively 
instead of reflectively. Once accepted, a conspiracy theory is highly resil¬ 
ient to change as believers engage in epistemic processes that are tainted 
by motivated reasoning and the confirmation bias: Believers selectively 
embrace evidence and expert testimonies that support their suspicions, and 
reject evidence and expert testimonies that disconfirms them (Brotherton, 
2015). The net result is an extensive theory that appears well elaborated, 
and supported by a lot of evidence. But while such theories may seem 
articulate, the decision to accept far-fetched conspiracy theories as true is 
actually rooted in gullibility. 

Two important observations need to be clarified in light of this conclu¬ 
sion. First, one might reason that people who believe conspiracy theories 
are critical and skeptic, but specifically about official readings of events and 
legitimate powerholders. Second, one might note that conspiracy theories 
can be quite rational from time to time. Corruption does occur in politics, 
business, and science, and there are many examples of conspiracy theories 
that turned out true eventually (e.g., Watergate; see Wright & Arbuthnot, 
1974). I do not dispute either of these observations, and would like to clar¬ 
ify here that true skepticism is different from gullibly accepting whatever 
policy-makers propose. A “healthy” critical mindset includes construc¬ 
tively scrutinizing the actions of power holders, and expressing concern 
whenever one suspects malpractice or bad policy. But true skepticism also 
implies critically assessing the evidence for accusations of conspiracy for¬ 
mation, and recognizing when such accusations are implausible (see also 
Fiedler, Chapter 7 this volume). Put differently, what true skepticism does 
not entail is uncritically accepting bizarre conspiracy theories such as that 
the Earth is flat, that human beings never landed on the Moon, or that on 
9/11 the impact of two passenger airplanes - flying at high speed and full of 
kerosene — had absolutely nothing to do with the Twin Towers collapsing 
shortly thereafter. 

While conspiracy beliefs are rooted in gullibility, this does not mean that 
conspiracy beliefs necessarily originate from closed-mindedness. In fact, 
studies found positive correlations between belief in conspiracy theories 
and the personality variable openness to experience (Swami et al., 2011; 
Swami et al., 2013). An interesting distinction here is between reflexive 
versus reflective open-mindedness (Pennycook et al., 2015). Reflexive 
open-mindedness refers to an intuitive mindset that is open to any new 
experience or information. Reflective open-mindedness, in contrast, 
refers to a critical mindset that is open to, yet also critically analyzes, new 
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opportunities or ideas. Integrating these insights with the evidence pre¬ 
sented in this chapter, it is possible that people who believe conspiracy 
theories are much like skeptics and scientists in their curiosity of, and open¬ 
ness to, novel ideas; but unlike skeptics and scientists, these novel ideas 
are evaluated through an intuitive, reflexive mindset instead of through a 
reflective mindset. 

One limitation of the current analysis, and a challenge for future 
research, pertains to sampling. I started out this chapter with the notion 
that people who are active on conspiracist websites perceive themselves 
as “critical freethinkers” (Harambam & Aupers, 2017). But while people 
who actively propagate conspiracy theories in online focus groups can be 
included in qualitative analyses, it is unclear at best if, and in what numbers, 
they took part in the quantitative studies that formed the basis of the cur¬ 
rent analysis. Put differently, there may be structural differences between 
the presumably small group of citizens that actively comes up with, and 
publishes online, novel conspiracy theories, as opposed to the large group 
of citizens that passively reads, believes, and spreads them. Based on the 
present analysis it is impossible to exclude the possibility that coming up 
with novel conspiracy theories, and successfully disseminating them among 
a large audience, is a creative process that requires analytic skills. Future 
research might therefore focus on differences in rationality versus gullibil¬ 
ity between people who actively and successfully create new conspiracy 
theories versus people who passively accept them. 

To conclude, in the present chapter I compared the two opposing ideas 
that (a) belief in conspiracy theories originates from rational skepticism ver¬ 
sus (b) belief in conspiracy theories originates from gullibility. The studies 
reviewed here unequivocally support the second idea. The mental processes 
that characterize rational skepticism fuels disbelief in most conspiracy theo¬ 
ries. While conspiracy theorists appear to have much faith in their beliefs, 
on average one may question the accuracy of their self-perception as “criti¬ 
cal freethinkers” (see also Dunning, Chapter 12 this volume). To return to 
the observations that motivated the current contribution: While some con¬ 
spiracist websites are keen on persuading citizens who disbelieve conspiracy 
theories to think more critically, the present chapter suggests that these 
“sheep” in the end may not be the gullible ones. 

Notes 

1 A common term among conspiracy theorists, combining “the people” with 
“sheep.” 

2 Note that while these arguments are correct in principle, the 9/11 "Melted Steel 
Theory” is flawed as it does not take into account the fact that the steel construc¬ 
tion of the Twin Towers did not have to melt for the buildings to collapse. The 
temperatures reached by burning kerosene that day were more than sufficient to 
weaken the steel construction up to the point that it could not carry the weight 
of the higher floors anymore (for details, see Dunbar & Reagan, 2011). 
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